Skip to content

Optimize arrays only with a session; keep constructors lazy - #10793

Open
robert3005 wants to merge 28 commits into
developfrom
rk/optimize-with-session
Open

Optimize arrays only with a session; keep constructors lazy#10793
robert3005 wants to merge 28 commits into
developfrom
rk/optimize-with-session

Conversation

@robert3005

@robert3005 robert3005 commented Oct 26, 2026

Copy link
Copy Markdown
Contributor

The session-less optimize is removed and optimize(session) is the only entry point, so every rewrite sees the session's registered kernels.

Builtins such as cast and fill_null, and slice, filter, take and apply, no longer optimize the node they build. Instead:

  • execute_until runs optimize_recursive with the context's session before it starts, and again over the array execution produced, so canonical results do not keep lazy children such as a filtered validity;
  • single-step execution optimizes with the session instead of trying only the static reduce rules;
  • whenever a rule rewrites a node, the nodes the rule built are optimized too, while subtrees that already existed are left alone, so inverse rules (slice over get_item and get_item over slice) cannot loop.

@robert3005 robert3005 added changelog/break A breaking API change action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage labels Oct 26, 2026
@github-actions github-actions Bot removed the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 26, 2026
@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ba9dbb7 clickbench-nvme 1 Explore Profiling Data
🟢 Done ba9dbb7 tpch-nvme-10 1 Explore Profiling Data
🟢 Done ba9dbb7 polarsignals 1 Explore Profiling Data
🟢 Done ba9dbb7 fineweb 1 Explore Profiling Data
🟢 Done ba9dbb7 tpch-nvme 1 Explore Profiling Data
🟢 Done ba9dbb7 tpcds-nvme 1 Explore Profiling Data
🟢 Done ba9dbb7 tpch-s3 1 Explore Profiling Data
Previous Runs (42)
Status Commit Job Attempt Link
🟢 Done e9809aa clickbench-nvme 1 Explore Profiling Data
🟢 Done e9809aa tpch-nvme-10 1 Explore Profiling Data
🟢 Done e9809aa polarsignals 1 Explore Profiling Data
🟢 Done e9809aa tpch-s3 1 Explore Profiling Data
🟢 Done e9809aa tpcds-nvme 1 Explore Profiling Data
🟢 Done e9809aa tpch-nvme 1 Explore Profiling Data
🟢 Done e9809aa fineweb 1 Explore Profiling Data
🟢 Done 221a559 clickbench-nvme 1 Explore Profiling Data
🟢 Done 221a559 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 221a559 polarsignals 1 Explore Profiling Data
🟢 Done 221a559 tpch-nvme 1 Explore Profiling Data
🟢 Done 221a559 tpch-s3 1 Explore Profiling Data
🟢 Done 221a559 tpcds-nvme 1 Explore Profiling Data
🟢 Done 221a559 fineweb 1 Explore Profiling Data
🟢 Done ab06f55 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done ab06f55 statpopgen 2 Explore Profiling Data
🟢 Done ab06f55 tpch-nvme-10 2 Explore Profiling Data
🟢 Done ab06f55 appian-nvme 2 Explore Profiling Data
🟢 Done ab06f55 tpch-nvme 2 Explore Profiling Data
🟢 Done ab06f55 tpch-s3 2 Explore Profiling Data
🟢 Done ab06f55 polarsignals 2 Explore Profiling Data
🟢 Done ab06f55 fineweb-s3 2 Explore Profiling Data
🟢 Done ab06f55 tpcds-nvme 2 Explore Profiling Data
🟢 Done ab06f55 clickbench-nvme 1 Explore Profiling Data
🟢 Done ab06f55 fineweb 1 Explore Profiling Data
🟢 Done ab06f55 tpch-s3-10 1 Explore Profiling Data
🟢 Done ab06f55 vortex-queries 1 Explore Profiling Data
🟢 Done ab06f55 job-nvme 1 Explore Profiling Data
🟢 Done be3d4e4 clickbench-sorted-nvme 2 Explore Profiling Data
🟢 Done be3d4e4 clickbench-nvme 2 Explore Profiling Data
🟢 Done be3d4e4 tpch-nvme-10 2 Explore Profiling Data
🟢 Done be3d4e4 appian-nvme 2 Explore Profiling Data
🟢 Done be3d4e4 fineweb-s3 2 Explore Profiling Data
🟢 Done be3d4e4 fineweb 2 Explore Profiling Data
🟢 Done be3d4e4 tpch-nvme 2 Explore Profiling Data
🟢 Done be3d4e4 vortex-queries 2 Explore Profiling Data
🟢 Done be3d4e4 tpch-s3-10 2 Explore Profiling Data
🟢 Done be3d4e4 statpopgen 2 Explore Profiling Data
🟢 Done be3d4e4 polarsignals 2 Explore Profiling Data
🟢 Done be3d4e4 job-nvme 2 Explore Profiling Data
🟢 Done be3d4e4 tpch-s3 2 Explore Profiling Data
🟢 Done be3d4e4 tpcds-nvme 2 Explore Profiling Data

Powered by Polar Signals Cloud

@codspeed

codspeed Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown

Merging this PR will degrade performance by 16.53%

2 warnings

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚠️ 1 benchmark is dominated by system calls

System calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.

Learn more about system calls

See affected benchmarks

⚡ 11 improved benchmarks
❌ 185 regressed benchmarks
✅ 2122 untouched benchmarks
🗄️ 47 archived benchmarks run1

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ CPU Simulation filter_powerlaw_by_random[10000] 684 ns 5,248.1 ns -86.97%
❌ CPU Simulation take[small_m/shuffled/primitive/nonnull/chunks=2048/indices=16] 211.7 µs 1,138 µs -81.4%
❌ CPU Simulation take[small_m/shuffled/primitive/nonnull/chunks=2048/indices=64] 428.1 µs 1,320.6 µs -67.59%
❌ CPU Simulation new_alp_prim_test_between[f64, 32768] 205.4 µs 601.6 µs -65.86%
❌ CPU Simulation new_alp_prim_test_between[f64, 16384] 137.8 µs 346.4 µs -60.21%
❌ Walltime mul_u64_nonnull_neon 20.3 µs 39.5 µs -48.64%
❌ CPU Simulation new_alp_prim_test_between[f32, 32768] 184.3 µs 358.1 µs -48.52%
❌ CPU Simulation take[small_m/shuffled/primitive/nonnull/chunks=256/indices=16] 126.5 µs 232.3 µs -45.52%
❌ CPU Simulation new_alp_prim_test_between[f32, 16384] 124.7 µs 223.8 µs -44.26%
❌ CPU Simulation search_index_in_range_chunked 331.3 µs 513.8 µs -35.52%
❌ CPU Simulation new_alp_prim_test_between[f64, 2048] 77 µs 116.1 µs -33.68%
❌ CPU Simulation take_filter_primitive_slice_mask_sequential_indices[16384, 1000] 48.3 µs 71.8 µs -32.7%
❌ CPU Simulation new_raw_prim_test_between[i32, 2048] 53.9 µs 79.3 µs -32.07%
❌ CPU Simulation take_filter_primitive_slice_mask_sequential_indices[4096, 1000] 50.5 µs 74.1 µs -31.78%
❌ CPU Simulation take[value_shape/duplicate99/struct8/nonnull/chunks=16/indices=100] 144.5 µs 210.9 µs -31.48%
❌ CPU Simulation new_alp_prim_test_between[f32, 2048] 70.2 µs 99.9 µs -29.71%
❌ CPU Simulation nullable_points_x_constant 1.1 ms 1.5 ms -29.23%
❌ CPU Simulation constant_x_nullable_points 1.1 ms 1.5 ms -28.31%
❌ CPU Simulation constant_x_nullable_polygons_disjoint 1.2 ms 1.6 ms -27.86%
❌ CPU Simulation nullable_polygons_disjoint_x_constant 1.1 ms 1.6 ms -27.86%
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing rk/optimize-with-session (ba9dbb7) with develop (96fc43d)

Open in CodSpeed

Footnotes

  1. 47 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ab06f552 vs base 85466bb6
Vortex (geomean): hot 0.991x ➖ · cold 1.074x ➖

datafusion / vortex-file-compressed / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44289640 / 44341454 / -0.1% 91634920 / 86924923 / +5.4% 0.48 / 0.51 / -5.3%
polarsignals_q01/datafusion:vortex-file-compressed 53455114 / 53479732 / -0.0% 119776538 / 121870786 / -1.7% 0.45 / 0.44 / +1.7%
polarsignals_q02/datafusion:vortex-file-compressed 12187621 / 11938568 / +2.1% 56710727 / 51697645 / +9.7% 0.21 / 0.23 / -6.9%
polarsignals_q03/datafusion:vortex-file-compressed 75381754 / 86641228 / -13.0% 🟢 122078810 / 146399792 / -16.6% 🟢 0.62 / 0.59 / +4.3%
polarsignals_q04/datafusion:vortex-file-compressed 9147068 / 9417360 / -2.9% 48527428 / 41855523 / +15.9% 🔴 0.19 / 0.22 / -16.2%
polarsignals_q05/datafusion:vortex-file-compressed 11854313 / 11438750 / +3.6% 52208604 / 44621434 / +17.0% 🔴 0.23 / 0.26 / -11.4%
polarsignals_q06/datafusion:vortex-file-compressed 23579251 / 23509814 / +0.3% 62851501 / 55084640 / +14.1% 🔴 0.38 / 0.43 / -12.1%
polarsignals_q07/datafusion:vortex-file-compressed 10931002 / 10978769 / -0.4% 50323251 / 44115226 / +14.1% 🔴 0.22 / 0.25 / -12.7%
polarsignals_q08/datafusion:vortex-file-compressed 102347269 / 97828230 / +4.6% 173107586 / 164569193 / +5.2% 0.59 / 0.59 / -0.5%
polarsignals_q09/datafusion:vortex-file-compressed 9904698 / 10069226 / -1.6% 47161771 / 40535550 / +16.3% 🔴 0.21 / 0.25 / -15.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: JOB on NVME 📖

Commits: PR ab06f552 vs base none
Vortex (geomean): no vortex data
Parquet (geomean): no parquet data

No baseline is available for this benchmark yet; PR measurements are shown without comparison.

duckdb / vortex-file-compressed / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:vortex-file-compressed 13899332 / — / no baseline 30374911 / — / no baseline 0.46 / — / no baseline
job_q02/duckdb:vortex-file-compressed 26305153 / — / no baseline 42961486 / — / no baseline 0.61 / — / no baseline
job_q03/duckdb:vortex-file-compressed 16253895 / — / no baseline 33898366 / — / no baseline 0.48 / — / no baseline
job_q04/duckdb:vortex-file-compressed 28294627 / — / no baseline 44183288 / — / no baseline 0.64 / — / no baseline
job_q05/duckdb:vortex-file-compressed 20066272 / — / no baseline 37829695 / — / no baseline 0.53 / — / no baseline
job_q06/duckdb:vortex-file-compressed 16422441 / — / no baseline 34234910 / — / no baseline 0.48 / — / no baseline
job_q07/duckdb:vortex-file-compressed 10085117 / — / no baseline 29308030 / — / no baseline 0.34 / — / no baseline
job_q08/duckdb:vortex-file-compressed 22570228 / — / no baseline 40956655 / — / no baseline 0.55 / — / no baseline
job_q09/duckdb:vortex-file-compressed 27762316 / — / no baseline 62714797 / — / no baseline 0.44 / — / no baseline
job_q10/duckdb:vortex-file-compressed 26152503 / — / no baseline 62282554 / — / no baseline 0.42 / — / no baseline
job_q100/duckdb:vortex-file-compressed 45128271 / — / no baseline 89694730 / — / no baseline 0.50 / — / no baseline
job_q101/duckdb:vortex-file-compressed 44167476 / — / no baseline 86567276 / — / no baseline 0.51 / — / no baseline
job_q102/duckdb:vortex-file-compressed 77453897 / — / no baseline 126759586 / — / no baseline 0.61 / — / no baseline
job_q103/duckdb:vortex-file-compressed 55655390 / — / no baseline 97897357 / — / no baseline 0.57 / — / no baseline
job_q104/duckdb:vortex-file-compressed 44724154 / — / no baseline 85829494 / — / no baseline 0.52 / — / no baseline
job_q105/duckdb:vortex-file-compressed 74984996 / — / no baseline 120274414 / — / no baseline 0.62 / — / no baseline
job_q106/duckdb:vortex-file-compressed 52697086 / — / no baseline 95466767 / — / no baseline 0.55 / — / no baseline
job_q107/duckdb:vortex-file-compressed 50432968 / — / no baseline 95037455 / — / no baseline 0.53 / — / no baseline
job_q108/duckdb:vortex-file-compressed 54275513 / — / no baseline 97732199 / — / no baseline 0.56 / — / no baseline
job_q109/duckdb:vortex-file-compressed 11999359 / — / no baseline 24858131 / — / no baseline 0.48 / — / no baseline
job_q11/duckdb:vortex-file-compressed 30163098 / — / no baseline 64368629 / — / no baseline 0.47 / — / no baseline
job_q110/duckdb:vortex-file-compressed 18794740 / — / no baseline 34621732 / — / no baseline 0.54 / — / no baseline
job_q111/duckdb:vortex-file-compressed 30575080 / — / no baseline 52671154 / — / no baseline 0.58 / — / no baseline
job_q112/duckdb:vortex-file-compressed 29888127 / — / no baseline 52176482 / — / no baseline 0.57 / — / no baseline
job_q113/duckdb:vortex-file-compressed 34105382 / — / no baseline 57917017 / — / no baseline 0.59 / — / no baseline
job_q12/duckdb:vortex-file-compressed 44645368 / — / no baseline 62762643 / — / no baseline 0.71 / — / no baseline
job_q13/duckdb:vortex-file-compressed 15941273 / — / no baseline 35471391 / — / no baseline 0.45 / — / no baseline
job_q14/duckdb:vortex-file-compressed 59964868 / — / no baseline 78652778 / — / no baseline 0.76 / — / no baseline
job_q15/duckdb:vortex-file-compressed 25783682 / — / no baseline 59623375 / — / no baseline 0.43 / — / no baseline
job_q16/duckdb:vortex-file-compressed 25891576 / — / no baseline 59612437 / — / no baseline 0.43 / — / no baseline
job_q17/duckdb:vortex-file-compressed 36586131 / — / no baseline 72915954 / — / no baseline 0.50 / — / no baseline
job_q18/duckdb:vortex-file-compressed 28965372 / — / no baseline 61241798 / — / no baseline 0.47 / — / no baseline
job_q19/duckdb:vortex-file-compressed 18837494 / — / no baseline 43630468 / — / no baseline 0.43 / — / no baseline
job_q20/duckdb:vortex-file-compressed 17618434 / — / no baseline 42366048 / — / no baseline 0.42 / — / no baseline
job_q21/duckdb:vortex-file-compressed 32812783 / — / no baseline 61591880 / — / no baseline 0.53 / — / no baseline
job_q22/duckdb:vortex-file-compressed 26155548 / — / no baseline 54693207 / — / no baseline 0.48 / — / no baseline
job_q23/duckdb:vortex-file-compressed 64540294 / — / no baseline 96678810 / — / no baseline 0.67 / — / no baseline
job_q24/duckdb:vortex-file-compressed 42192284 / — / no baseline 76528492 / — / no baseline 0.55 / — / no baseline
job_q25/duckdb:vortex-file-compressed 35972045 / — / no baseline 70812664 / — / no baseline 0.51 / — / no baseline
job_q26/duckdb:vortex-file-compressed 89136555 / — / no baseline 128103852 / — / no baseline 0.70 / — / no baseline
job_q27/duckdb:vortex-file-compressed 29698706 / — / no baseline 59351600 / — / no baseline 0.50 / — / no baseline
job_q28/duckdb:vortex-file-compressed 25928785 / — / no baseline 56336205 / — / no baseline 0.46 / — / no baseline
job_q29/duckdb:vortex-file-compressed 85454218 / — / no baseline 104531144 / — / no baseline 0.82 / — / no baseline
job_q30/duckdb:vortex-file-compressed 69229176 / — / no baseline 86287203 / — / no baseline 0.80 / — / no baseline
job_q31/duckdb:vortex-file-compressed 63699532 / — / no baseline 102311964 / — / no baseline 0.62 / — / no baseline
job_q32/duckdb:vortex-file-compressed 50203725 / — / no baseline 88748144 / — / no baseline 0.57 / — / no baseline
job_q33/duckdb:vortex-file-compressed 63447330 / — / no baseline 92632082 / — / no baseline 0.68 / — / no baseline
job_q34/duckdb:vortex-file-compressed 128159122 / — / no baseline 162965592 / — / no baseline 0.79 / — / no baseline
job_q35/duckdb:vortex-file-compressed 29689376 / — / no baseline 58710455 / — / no baseline 0.51 / — / no baseline
job_q36/duckdb:vortex-file-compressed 23235876 / — / no baseline 51770345 / — / no baseline 0.45 / — / no baseline
job_q37/duckdb:vortex-file-compressed 53642680 / — / no baseline 86644733 / — / no baseline 0.62 / — / no baseline
job_q38/duckdb:vortex-file-compressed 20572890 / — / no baseline 42966773 / — / no baseline 0.48 / — / no baseline
job_q39/duckdb:vortex-file-compressed 17615056 / — / no baseline 36475577 / — / no baseline 0.48 / — / no baseline
job_q40/duckdb:vortex-file-compressed 95129594 / — / no baseline 121947857 / — / no baseline 0.78 / — / no baseline
job_q41/duckdb:vortex-file-compressed 265519374 / — / no baseline 289813805 / — / no baseline 0.92 / — / no baseline
job_q42/duckdb:vortex-file-compressed 33644563 / — / no baseline 55678268 / — / no baseline 0.60 / — / no baseline
job_q43/duckdb:vortex-file-compressed 26069434 / — / no baseline 46613790 / — / no baseline 0.56 / — / no baseline
job_q44/duckdb:vortex-file-compressed 46314878 / — / no baseline 68554229 / — / no baseline 0.68 / — / no baseline
job_q45/duckdb:vortex-file-compressed 74923374 / — / no baseline 102884065 / — / no baseline 0.73 / — / no baseline
job_q46/duckdb:vortex-file-compressed 26648061 / — / no baseline 47532352 / — / no baseline 0.56 / — / no baseline
job_q47/duckdb:vortex-file-compressed 23679984 / — / no baseline 47048640 / — / no baseline 0.50 / — / no baseline
job_q48/duckdb:vortex-file-compressed 76389080 / — / no baseline 98330457 / — / no baseline 0.78 / — / no baseline
job_q49/duckdb:vortex-file-compressed 44391784 / — / no baseline 68375919 / — / no baseline 0.65 / — / no baseline
job_q50/duckdb:vortex-file-compressed 39017255 / — / no baseline 61762821 / — / no baseline 0.63 / — / no baseline
job_q51/duckdb:vortex-file-compressed 65851184 / — / no baseline 89399698 / — / no baseline 0.74 / — / no baseline
job_q52/duckdb:vortex-file-compressed 53818403 / — / no baseline 83853652 / — / no baseline 0.64 / — / no baseline
job_q53/duckdb:vortex-file-compressed 49966276 / — / no baseline 81495050 / — / no baseline 0.61 / — / no baseline
job_q54/duckdb:vortex-file-compressed 62871192 / — / no baseline 94374328 / — / no baseline 0.67 / — / no baseline
job_q55/duckdb:vortex-file-compressed 58383094 / — / no baseline 87224075 / — / no baseline 0.67 / — / no baseline
job_q56/duckdb:vortex-file-compressed 38475994 / — / no baseline 74287718 / — / no baseline 0.52 / — / no baseline
job_q57/duckdb:vortex-file-compressed 84358223 / — / no baseline 113828637 / — / no baseline 0.74 / — / no baseline
job_q58/duckdb:vortex-file-compressed 67607802 / — / no baseline 101622561 / — / no baseline 0.67 / — / no baseline
job_q59/duckdb:vortex-file-compressed 63418188 / — / no baseline 100334075 / — / no baseline 0.63 / — / no baseline
job_q60/duckdb:vortex-file-compressed 43010550 / — / no baseline 68622640 / — / no baseline 0.63 / — / no baseline
job_q61/duckdb:vortex-file-compressed 32820794 / — / no baseline 60421370 / — / no baseline 0.54 / — / no baseline
job_q62/duckdb:vortex-file-compressed 31927934 / — / no baseline 60567442 / — / no baseline 0.53 / — / no baseline
job_q63/duckdb:vortex-file-compressed 34241780 / — / no baseline 64494834 / — / no baseline 0.53 / — / no baseline
job_q64/duckdb:vortex-file-compressed 58280236 / — / no baseline 91680276 / — / no baseline 0.64 / — / no baseline
job_q65/duckdb:vortex-file-compressed 49329004 / — / no baseline 76079339 / — / no baseline 0.65 / — / no baseline
job_q66/duckdb:vortex-file-compressed 41433331 / — / no baseline 79328687 / — / no baseline 0.52 / — / no baseline
job_q67/duckdb:vortex-file-compressed 42251547 / — / no baseline 74785714 / — / no baseline 0.56 / — / no baseline
job_q68/duckdb:vortex-file-compressed 51697740 / — / no baseline 83774604 / — / no baseline 0.62 / — / no baseline
job_q69/duckdb:vortex-file-compressed 79712496 / — / no baseline 117413982 / — / no baseline 0.68 / — / no baseline
job_q70/duckdb:vortex-file-compressed 46951338 / — / no baseline 85730081 / — / no baseline 0.55 / — / no baseline
job_q71/duckdb:vortex-file-compressed 70327449 / — / no baseline 109768625 / — / no baseline 0.64 / — / no baseline
job_q72/duckdb:vortex-file-compressed 143819992 / — / no baseline 181001264 / — / no baseline 0.79 / — / no baseline
job_q73/duckdb:vortex-file-compressed 88276418 / — / no baseline 132237471 / — / no baseline 0.67 / — / no baseline
job_q74/duckdb:vortex-file-compressed 77928962 / — / no baseline 124569694 / — / no baseline 0.63 / — / no baseline
job_q75/duckdb:vortex-file-compressed 69308533 / — / no baseline 116217720 / — / no baseline 0.60 / — / no baseline
job_q76/duckdb:vortex-file-compressed 28341868 / — / no baseline 59401352 / — / no baseline 0.48 / — / no baseline
job_q77/duckdb:vortex-file-compressed 27662458 / — / no baseline 55724712 / — / no baseline 0.50 / — / no baseline
job_q78/duckdb:vortex-file-compressed 29777106 / — / no baseline 58487701 / — / no baseline 0.51 / — / no baseline
job_q79/duckdb:vortex-file-compressed 76705743 / — / no baseline 104084204 / — / no baseline 0.74 / — / no baseline
job_q80/duckdb:vortex-file-compressed 52808610 / — / no baseline 79474615 / — / no baseline 0.66 / — / no baseline
job_q81/duckdb:vortex-file-compressed 165133775 / — / no baseline 191370348 / — / no baseline 0.86 / — / no baseline
job_q82/duckdb:vortex-file-compressed 305929004 / — / no baseline 332988800 / — / no baseline 0.92 / — / no baseline
job_q83/duckdb:vortex-file-compressed 44223532 / — / no baseline 73222945 / — / no baseline 0.60 / — / no baseline
job_q84/duckdb:vortex-file-compressed 42903550 / — / no baseline 73529858 / — / no baseline 0.58 / — / no baseline
job_q85/duckdb:vortex-file-compressed 50024528 / — / no baseline 79227871 / — / no baseline 0.63 / — / no baseline
job_q86/duckdb:vortex-file-compressed 69726065 / — / no baseline 113542544 / — / no baseline 0.61 / — / no baseline
job_q87/duckdb:vortex-file-compressed 64822429 / — / no baseline 108871304 / — / no baseline 0.60 / — / no baseline
job_q88/duckdb:vortex-file-compressed 51935885 / — / no baseline 92313185 / — / no baseline 0.56 / — / no baseline
job_q89/duckdb:vortex-file-compressed 34572078 / — / no baseline 75672955 / — / no baseline 0.46 / — / no baseline
job_q90/duckdb:vortex-file-compressed 74280003 / — / no baseline 115621004 / — / no baseline 0.64 / — / no baseline
job_q91/duckdb:vortex-file-compressed 63429080 / — / no baseline 113475123 / — / no baseline 0.56 / — / no baseline
job_q92/duckdb:vortex-file-compressed 46055246 / — / no baseline 91659246 / — / no baseline 0.50 / — / no baseline
job_q93/duckdb:vortex-file-compressed 72455448 / — / no baseline 120396816 / — / no baseline 0.60 / — / no baseline
job_q94/duckdb:vortex-file-compressed 28523028 / — / no baseline 55076769 / — / no baseline 0.52 / — / no baseline
job_q95/duckdb:vortex-file-compressed 26982086 / — / no baseline 54167493 / — / no baseline 0.50 / — / no baseline
job_q96/duckdb:vortex-file-compressed 29365428 / — / no baseline 58063514 / — / no baseline 0.51 / — / no baseline
job_q97/duckdb:vortex-file-compressed 97374268 / — / no baseline 144044687 / — / no baseline 0.68 / — / no baseline
job_q98/duckdb:vortex-file-compressed 61232602 / — / no baseline 105770234 / — / no baseline 0.58 / — / no baseline
job_q99/duckdb:vortex-file-compressed 90166835 / — / no baseline 136667008 / — / no baseline 0.66 / — / no baseline
duckdb / parquet / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:parquet 59664128 / — / no baseline 70935103 / — / no baseline 0.84 / — / no baseline
job_q02/duckdb:parquet 149535928 / — / no baseline 167111358 / — / no baseline 0.89 / — / no baseline
job_q03/duckdb:parquet 90931364 / — / no baseline 101169858 / — / no baseline 0.90 / — / no baseline
job_q04/duckdb:parquet 170569687 / — / no baseline 182375651 / — / no baseline 0.94 / — / no baseline
job_q05/duckdb:parquet 77708390 / — / no baseline 90270530 / — / no baseline 0.86 / — / no baseline
job_q06/duckdb:parquet 74470865 / — / no baseline 87365966 / — / no baseline 0.85 / — / no baseline
job_q07/duckdb:parquet 32522587 / — / no baseline 44179595 / — / no baseline 0.74 / — / no baseline
job_q08/duckdb:parquet 94064697 / — / no baseline 106851260 / — / no baseline 0.88 / — / no baseline
job_q09/duckdb:parquet 292758538 / — / no baseline 361011270 / — / no baseline 0.81 / — / no baseline
job_q10/duckdb:parquet 242918752 / — / no baseline 265139959 / — / no baseline 0.92 / — / no baseline
job_q100/duckdb:parquet 226573280 / — / no baseline 270822104 / — / no baseline 0.84 / — / no baseline
job_q101/duckdb:parquet 229840998 / — / no baseline 270558043 / — / no baseline 0.85 / — / no baseline
job_q102/duckdb:parquet 261635948 / — / no baseline 300971553 / — / no baseline 0.87 / — / no baseline
job_q103/duckdb:parquet 214196963 / — / no baseline 233059386 / — / no baseline 0.92 / — / no baseline
job_q104/duckdb:parquet 167420940 / — / no baseline 197406460 / — / no baseline 0.85 / — / no baseline
job_q105/duckdb:parquet 209395324 / — / no baseline 232240868 / — / no baseline 0.90 / — / no baseline
job_q106/duckdb:parquet 230173848 / — / no baseline 266444955 / — / no baseline 0.86 / — / no baseline
job_q107/duckdb:parquet 206914674 / — / no baseline 236574932 / — / no baseline 0.87 / — / no baseline
job_q108/duckdb:parquet 228204679 / — / no baseline 298687264 / — / no baseline 0.76 / — / no baseline
job_q109/duckdb:parquet 30565273 / — / no baseline 37336724 / — / no baseline 0.82 / — / no baseline
job_q11/duckdb:parquet 326856734 / — / no baseline 346752302 / — / no baseline 0.94 / — / no baseline
job_q110/duckdb:parquet 78983107 / — / no baseline 88603531 / — / no baseline 0.89 / — / no baseline
job_q111/duckdb:parquet 111344186 / — / no baseline 120397849 / — / no baseline 0.92 / — / no baseline
job_q112/duckdb:parquet 108123321 / — / no baseline 118492235 / — / no baseline 0.91 / — / no baseline
job_q113/duckdb:parquet 119485054 / — / no baseline 131018576 / — / no baseline 0.91 / — / no baseline
job_q12/duckdb:parquet 108833900 / — / no baseline 118883033 / — / no baseline 0.92 / — / no baseline
job_q13/duckdb:parquet 61169990 / — / no baseline 73582795 / — / no baseline 0.83 / — / no baseline
job_q14/duckdb:parquet 126336472 / — / no baseline 138156456 / — / no baseline 0.91 / — / no baseline
job_q15/duckdb:parquet 363728511 / — / no baseline 387017631 / — / no baseline 0.94 / — / no baseline
job_q16/duckdb:parquet 316018380 / — / no baseline 341655305 / — / no baseline 0.92 / — / no baseline
job_q17/duckdb:parquet 306149386 / — / no baseline 342028744 / — / no baseline 0.90 / — / no baseline
job_q18/duckdb:parquet 85951857 / — / no baseline 101566923 / — / no baseline 0.85 / — / no baseline
job_q19/duckdb:parquet 72664818 / — / no baseline 85791955 / — / no baseline 0.85 / — / no baseline
job_q20/duckdb:parquet 72761870 / — / no baseline 86246130 / — / no baseline 0.84 / — / no baseline
job_q21/duckdb:parquet 116701318 / — / no baseline 135137583 / — / no baseline 0.86 / — / no baseline
job_q22/duckdb:parquet 111412492 / — / no baseline 129639903 / — / no baseline 0.86 / — / no baseline
job_q23/duckdb:parquet 199318044 / — / no baseline 226280195 / — / no baseline 0.88 / — / no baseline
job_q24/duckdb:parquet 167026978 / — / no baseline 191907152 / — / no baseline 0.87 / — / no baseline
job_q25/duckdb:parquet 134773676 / — / no baseline 157516367 / — / no baseline 0.86 / — / no baseline
job_q26/duckdb:parquet 322743082 / — / no baseline 351960111 / — / no baseline 0.92 / — / no baseline
job_q27/duckdb:parquet 134352712 / — / no baseline 154733903 / — / no baseline 0.87 / — / no baseline
job_q28/duckdb:parquet 145463002 / — / no baseline 159621981 / — / no baseline 0.91 / — / no baseline
job_q29/duckdb:parquet 392909596 / — / no baseline 411862424 / — / no baseline 0.95 / — / no baseline
job_q30/duckdb:parquet 206926864 / — / no baseline 220179806 / — / no baseline 0.94 / — / no baseline
job_q31/duckdb:parquet 317139714 / — / no baseline 336959003 / — / no baseline 0.94 / — / no baseline
job_q32/duckdb:parquet 273616066 / — / no baseline 300311530 / — / no baseline 0.91 / — / no baseline
job_q33/duckdb:parquet 260270328 / — / no baseline 297073326 / — / no baseline 0.88 / — / no baseline
job_q34/duckdb:parquet 419897752 / — / no baseline 443502030 / — / no baseline 0.95 / — / no baseline
job_q35/duckdb:parquet 143362661 / — / no baseline 159262379 / — / no baseline 0.90 / — / no baseline
job_q36/duckdb:parquet 87102871 / — / no baseline 104893530 / — / no baseline 0.83 / — / no baseline
job_q37/duckdb:parquet 249814085 / — / no baseline 271628412 / — / no baseline 0.92 / — / no baseline
job_q38/duckdb:parquet 66457326 / — / no baseline 81791801 / — / no baseline 0.81 / — / no baseline
job_q39/duckdb:parquet 64418232 / — / no baseline 74412954 / — / no baseline 0.87 / — / no baseline
job_q40/duckdb:parquet 82390819 / — / no baseline 96011637 / — / no baseline 0.86 / — / no baseline
job_q41/duckdb:parquet 93831531 / — / no baseline 105040236 / — / no baseline 0.89 / — / no baseline
job_q42/duckdb:parquet 158889748 / — / no baseline 163489552 / — / no baseline 0.97 / — / no baseline
job_q43/duckdb:parquet 55976348 / — / no baseline 73043517 / — / no baseline 0.77 / — / no baseline
job_q44/duckdb:parquet 170195995 / — / no baseline 200231691 / — / no baseline 0.85 / — / no baseline
job_q45/duckdb:parquet 179998806 / — / no baseline 194381259 / — / no baseline 0.93 / — / no baseline
job_q46/duckdb:parquet 113085404 / — / no baseline 128095102 / — / no baseline 0.88 / — / no baseline
job_q47/duckdb:parquet 93598856 / — / no baseline 106011521 / — / no baseline 0.88 / — / no baseline
job_q48/duckdb:parquet 174932816 / — / no baseline 187591570 / — / no baseline 0.93 / — / no baseline
job_q49/duckdb:parquet 163370111 / — / no baseline 220100566 / — / no baseline 0.74 / — / no baseline
job_q50/duckdb:parquet 128241052 / — / no baseline 161886136 / — / no baseline 0.79 / — / no baseline
job_q51/duckdb:parquet 198834231 / — / no baseline 213896655 / — / no baseline 0.93 / — / no baseline
job_q52/duckdb:parquet 183893782 / — / no baseline 208459239 / — / no baseline 0.88 / — / no baseline
job_q53/duckdb:parquet 170918509 / — / no baseline 198062420 / — / no baseline 0.86 / — / no baseline
job_q54/duckdb:parquet 173086418 / — / no baseline 203405655 / — / no baseline 0.85 / — / no baseline
job_q55/duckdb:parquet 176010964 / — / no baseline 192226398 / — / no baseline 0.92 / — / no baseline
job_q56/duckdb:parquet 155609024 / — / no baseline 182320700 / — / no baseline 0.85 / — / no baseline
job_q57/duckdb:parquet 208184138 / — / no baseline 233906100 / — / no baseline 0.89 / — / no baseline
job_q58/duckdb:parquet 241015714 / — / no baseline 269613931 / — / no baseline 0.89 / — / no baseline
job_q59/duckdb:parquet 226888410 / — / no baseline 249601820 / — / no baseline 0.91 / — / no baseline
job_q60/duckdb:parquet 94836850 / — / no baseline 113379629 / — / no baseline 0.84 / — / no baseline
job_q61/duckdb:parquet 77659434 / — / no baseline 95105705 / — / no baseline 0.82 / — / no baseline
job_q62/duckdb:parquet 74461758 / — / no baseline 91752834 / — / no baseline 0.81 / — / no baseline
job_q63/duckdb:parquet 90842688 / — / no baseline 108914927 / — / no baseline 0.83 / — / no baseline
job_q64/duckdb:parquet 160861327 / — / no baseline 185960524 / — / no baseline 0.87 / — / no baseline
job_q65/duckdb:parquet 111593478 / — / no baseline 128402277 / — / no baseline 0.87 / — / no baseline
job_q66/duckdb:parquet 187508425 / — / no baseline 216166653 / — / no baseline 0.87 / — / no baseline
job_q67/duckdb:parquet 268404179 / — / no baseline 205587538 / — / no baseline 1.31 / — / no baseline
job_q68/duckdb:parquet 184868908 / — / no baseline 215436596 / — / no baseline 0.86 / — / no baseline
job_q69/duckdb:parquet 309005754 / — / no baseline 332537407 / — / no baseline 0.93 / — / no baseline
job_q70/duckdb:parquet 240531710 / — / no baseline 261626607 / — / no baseline 0.92 / — / no baseline
job_q71/duckdb:parquet 206571709 / — / no baseline 227726638 / — / no baseline 0.91 / — / no baseline
job_q72/duckdb:parquet 293058385 / — / no baseline 312019925 / — / no baseline 0.94 / — / no baseline
job_q73/duckdb:parquet 197963187 / — / no baseline 223807813 / — / no baseline 0.88 / — / no baseline
job_q74/duckdb:parquet 197275558 / — / no baseline 226074088 / — / no baseline 0.87 / — / no baseline
job_q75/duckdb:parquet 228760809 / — / no baseline 255120739 / — / no baseline 0.90 / — / no baseline
job_q76/duckdb:parquet 139748514 / — / no baseline 171729401 / — / no baseline 0.81 / — / no baseline
job_q77/duckdb:parquet 130106667 / — / no baseline 151555497 / — / no baseline 0.86 / — / no baseline
job_q78/duckdb:parquet 131830287 / — / no baseline 170069668 / — / no baseline 0.78 / — / no baseline
job_q79/duckdb:parquet 258741777 / — / no baseline 280417635 / — / no baseline 0.92 / — / no baseline
job_q80/duckdb:parquet 231514839 / — / no baseline 273099117 / — / no baseline 0.85 / — / no baseline
job_q81/duckdb:parquet 366934642 / — / no baseline 390715075 / — / no baseline 0.94 / — / no baseline
job_q82/duckdb:parquet 285498913 / — / no baseline 336381484 / — / no baseline 0.85 / — / no baseline
job_q83/duckdb:parquet 133216012 / — / no baseline 149305559 / — / no baseline 0.89 / — / no baseline
job_q84/duckdb:parquet 139956548 / — / no baseline 139169244 / — / no baseline 1.01 / — / no baseline
job_q85/duckdb:parquet 129240466 / — / no baseline 155658196 / — / no baseline 0.83 / — / no baseline
job_q86/duckdb:parquet 228738282 / — / no baseline 259355475 / — / no baseline 0.88 / — / no baseline
job_q87/duckdb:parquet 205246166 / — / no baseline 245884301 / — / no baseline 0.83 / — / no baseline
job_q88/duckdb:parquet 202055150 / — / no baseline 245513944 / — / no baseline 0.82 / — / no baseline
job_q89/duckdb:parquet 177793484 / — / no baseline 200279239 / — / no baseline 0.89 / — / no baseline
job_q90/duckdb:parquet 229863580 / — / no baseline 305239366 / — / no baseline 0.75 / — / no baseline
job_q91/duckdb:parquet 257052278 / — / no baseline 289736872 / — / no baseline 0.89 / — / no baseline
job_q92/duckdb:parquet 200423376 / — / no baseline 231716384 / — / no baseline 0.86 / — / no baseline
job_q93/duckdb:parquet 244725047 / — / no baseline 272436476 / — / no baseline 0.90 / — / no baseline
job_q94/duckdb:parquet 143983189 / — / no baseline 166104001 / — / no baseline 0.87 / — / no baseline
job_q95/duckdb:parquet 123129486 / — / no baseline 149798325 / — / no baseline 0.82 / — / no baseline
job_q96/duckdb:parquet 145715435 / — / no baseline 165824331 / — / no baseline 0.88 / — / no baseline
job_q97/duckdb:parquet 252578686 / — / no baseline 325754238 / — / no baseline 0.78 / — / no baseline
job_q98/duckdb:parquet 201460443 / — / no baseline 234284842 / — / no baseline 0.86 / — / no baseline
job_q99/duckdb:parquet 254439646 / — / no baseline 269790373 / — / no baseline 0.94 / — / no baseline
duckdb / duckdb / ns (no group data, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
job_q01/duckdb:duckdb 7904182 / — / no baseline 17047126 / — / no baseline 0.46 / — / no baseline
job_q02/duckdb:duckdb 6049130 / — / no baseline 13875886 / — / no baseline 0.44 / — / no baseline
job_q03/duckdb:duckdb 6656664 / — / no baseline 15095274 / — / no baseline 0.44 / — / no baseline
job_q04/duckdb:duckdb 6310736 / — / no baseline 14518256 / — / no baseline 0.43 / — / no baseline
job_q05/duckdb:duckdb 14692573 / — / no baseline 26162962 / — / no baseline 0.56 / — / no baseline
job_q06/duckdb:duckdb 14353145 / — / no baseline 25414177 / — / no baseline 0.56 / — / no baseline
job_q07/duckdb:duckdb 11212355 / — / no baseline 20076992 / — / no baseline 0.56 / — / no baseline
job_q08/duckdb:duckdb 16374781 / — / no baseline 27416811 / — / no baseline 0.60 / — / no baseline
job_q09/duckdb:duckdb 64380294 / — / no baseline 87977847 / — / no baseline 0.73 / — / no baseline
job_q10/duckdb:duckdb 42376048 / — / no baseline 72217337 / — / no baseline 0.59 / — / no baseline
job_q100/duckdb:duckdb 25066066 / — / no baseline 45830064 / — / no baseline 0.55 / — / no baseline
job_q101/duckdb:duckdb 26795086 / — / no baseline 54065791 / — / no baseline 0.50 / — / no baseline
job_q102/duckdb:duckdb 44821858 / — / no baseline 74518953 / — / no baseline 0.60 / — / no baseline
job_q103/duckdb:duckdb 54835059 / — / no baseline 86583392 / — / no baseline 0.63 / — / no baseline
job_q104/duckdb:duckdb 48212035 / — / no baseline 74974532 / — / no baseline 0.64 / — / no baseline
job_q105/duckdb:duckdb 75435798 / — / no baseline 105199326 / — / no baseline 0.72 / — / no baseline
job_q106/duckdb:duckdb 66333858 / — / no baseline 96651761 / — / no baseline 0.69 / — / no baseline
job_q107/duckdb:duckdb 61124852 / — / no baseline 91507040 / — / no baseline 0.67 / — / no baseline
job_q108/duckdb:duckdb 76693786 / — / no baseline 109164597 / — / no baseline 0.70 / — / no baseline
job_q109/duckdb:duckdb 7279130 / — / no baseline 16188696 / — / no baseline 0.45 / — / no baseline
job_q11/duckdb:duckdb 48871761 / — / no baseline 88096425 / — / no baseline 0.55 / — / no baseline
job_q110/duckdb:duckdb 13761200 / — / no baseline 23860045 / — / no baseline 0.58 / — / no baseline
job_q111/duckdb:duckdb 17105252 / — / no baseline 29081705 / — / no baseline 0.59 / — / no baseline
job_q112/duckdb:duckdb 22340291 / — / no baseline 35412241 / — / no baseline 0.63 / — / no baseline
job_q113/duckdb:duckdb 18619945 / — / no baseline 32003441 / — / no baseline 0.58 / — / no baseline
job_q12/duckdb:duckdb 27373716 / — / no baseline 37390897 / — / no baseline 0.73 / — / no baseline
job_q13/duckdb:duckdb 10345828 / — / no baseline 19328228 / — / no baseline 0.54 / — / no baseline
job_q14/duckdb:duckdb 36045206 / — / no baseline 45716915 / — / no baseline 0.79 / — / no baseline
job_q15/duckdb:duckdb 56818004 / — / no baseline 89112201 / — / no baseline 0.64 / — / no baseline
job_q16/duckdb:duckdb 47365455 / — / no baseline 82561198 / — / no baseline 0.57 / — / no baseline
job_q17/duckdb:duckdb 55019300 / — / no baseline 79885023 / — / no baseline 0.69 / — / no baseline
job_q18/duckdb:duckdb 22056770 / — / no baseline 45641198 / — / no baseline 0.48 / — / no baseline
job_q19/duckdb:duckdb 12322945 / — / no baseline 21725351 / — / no baseline 0.57 / — / no baseline
job_q20/duckdb:duckdb 15807242 / — / no baseline 33762518 / — / no baseline 0.47 / — / no baseline
job_q21/duckdb:duckdb 22912896 / — / no baseline 33960298 / — / no baseline 0.67 / — / no baseline
job_q22/duckdb:duckdb 22179158 / — / no baseline 43913596 / — / no baseline 0.51 / — / no baseline
job_q23/duckdb:duckdb 40706296 / — / no baseline 60118969 / — / no baseline 0.68 / — / no baseline
job_q24/duckdb:duckdb 17626010 / — / no baseline 33239480 / — / no baseline 0.53 / — / no baseline
job_q25/duckdb:duckdb 16057710 / — / no baseline 28703800 / — / no baseline 0.56 / — / no baseline
job_q26/duckdb:duckdb 78370631 / — / no baseline 131646778 / — / no baseline 0.60 / — / no baseline
job_q27/duckdb:duckdb 26890339 / — / no baseline 43440046 / — / no baseline 0.62 / — / no baseline
job_q28/duckdb:duckdb 25477911 / — / no baseline 40999878 / — / no baseline 0.62 / — / no baseline
job_q29/duckdb:duckdb 87050230 / — / no baseline 102388947 / — / no baseline 0.85 / — / no baseline
job_q30/duckdb:duckdb 56989315 / — / no baseline 71243505 / — / no baseline 0.80 / — / no baseline
job_q31/duckdb:duckdb 67621364 / — / no baseline 90753035 / — / no baseline 0.75 / — / no baseline
job_q32/duckdb:duckdb 47225578 / — / no baseline 72650924 / — / no baseline 0.65 / — / no baseline
job_q33/duckdb:duckdb 57414162 / — / no baseline 78070481 / — / no baseline 0.74 / — / no baseline
job_q34/duckdb:duckdb 93461407 / — / no baseline 112137122 / — / no baseline 0.83 / — / no baseline
job_q35/duckdb:duckdb 22397390 / — / no baseline 40224475 / — / no baseline 0.56 / — / no baseline
job_q36/duckdb:duckdb 15816470 / — / no baseline 32722501 / — / no baseline 0.48 / — / no baseline
job_q37/duckdb:duckdb 50579016 / — / no baseline 75085589 / — / no baseline 0.67 / — / no baseline
job_q38/duckdb:duckdb 18202419 / — / no baseline 32751140 / — / no baseline 0.56 / — / no baseline
job_q39/duckdb:duckdb 14387047 / — / no baseline 26572161 / — / no baseline 0.54 / — / no baseline
job_q40/duckdb:duckdb 26816336 / — / no baseline 38669382 / — / no baseline 0.69 / — / no baseline
job_q41/duckdb:duckdb 40478916 / — / no baseline 52544327 / — / no baseline 0.77 / — / no baseline
job_q42/duckdb:duckdb 20923766 / — / no baseline 32210658 / — / no baseline 0.65 / — / no baseline
job_q43/duckdb:duckdb 24434004 / — / no baseline 36521965 / — / no baseline 0.67 / — / no baseline
job_q44/duckdb:duckdb 30042795 / — / no baseline 40847112 / — / no baseline 0.74 / — / no baseline
job_q45/duckdb:duckdb 22627973 / — / no baseline 35216448 / — / no baseline 0.64 / — / no baseline
job_q46/duckdb:duckdb 35123925 / — / no baseline 47911091 / — / no baseline 0.73 / — / no baseline
job_q47/duckdb:duckdb 32761476 / — / no baseline 44144012 / — / no baseline 0.74 / — / no baseline
job_q48/duckdb:duckdb 59610216 / — / no baseline 71687132 / — / no baseline 0.83 / — / no baseline
job_q49/duckdb:duckdb 53207216 / — / no baseline 68751549 / — / no baseline 0.77 / — / no baseline
job_q50/duckdb:duckdb 27807579 / — / no baseline 40208499 / — / no baseline 0.69 / — / no baseline
job_q51/duckdb:duckdb 39322038 / — / no baseline 51098363 / — / no baseline 0.77 / — / no baseline
job_q52/duckdb:duckdb 35081049 / — / no baseline 51495253 / — / no baseline 0.68 / — / no baseline
job_q53/duckdb:duckdb 22894472 / — / no baseline 38383518 / — / no baseline 0.60 / — / no baseline
job_q54/duckdb:duckdb 59025108 / — / no baseline 75564198 / — / no baseline 0.78 / — / no baseline
job_q55/duckdb:duckdb 67241212 / — / no baseline 82948781 / — / no baseline 0.81 / — / no baseline
job_q56/duckdb:duckdb 25028494 / — / no baseline 47957636 / — / no baseline 0.52 / — / no baseline
job_q57/duckdb:duckdb 112000973 / — / no baseline 133640988 / — / no baseline 0.84 / — / no baseline
job_q58/duckdb:duckdb 45838410 / — / no baseline 70285861 / — / no baseline 0.65 / — / no baseline
job_q59/duckdb:duckdb 41984308 / — / no baseline 65153869 / — / no baseline 0.64 / — / no baseline
job_q60/duckdb:duckdb 47421378 / — / no baseline 66808543 / — / no baseline 0.71 / — / no baseline
job_q61/duckdb:duckdb 54083236 / — / no baseline 72650263 / — / no baseline 0.74 / — / no baseline
job_q62/duckdb:duckdb 53755778 / — / no baseline 71226640 / — / no baseline 0.75 / — / no baseline
job_q63/duckdb:duckdb 58258086 / — / no baseline 77984370 / — / no baseline 0.75 / — / no baseline
job_q64/duckdb:duckdb 46754950 / — / no baseline 67372374 / — / no baseline 0.69 / — / no baseline
job_q65/duckdb:duckdb 74832691 / — / no baseline 92152216 / — / no baseline 0.81 / — / no baseline
job_q66/duckdb:duckdb 54707080 / — / no baseline 88192529 / — / no baseline 0.62 / — / no baseline
job_q67/duckdb:duckdb 24569387 / — / no baseline 49730466 / — / no baseline 0.49 / — / no baseline
job_q68/duckdb:duckdb 53273701 / — / no baseline 78352881 / — / no baseline 0.68 / — / no baseline
job_q69/duckdb:duckdb 77456415 / — / no baseline 99236502 / — / no baseline 0.78 / — / no baseline
job_q70/duckdb:duckdb 46586114 / — / no baseline 66366571 / — / no baseline 0.70 / — / no baseline
job_q71/duckdb:duckdb 81052552 / — / no baseline 102114872 / — / no baseline 0.79 / — / no baseline
job_q72/duckdb:duckdb 109554725 / — / no baseline 128335601 / — / no baseline 0.85 / — / no baseline
job_q73/duckdb:duckdb 65564780 / — / no baseline 88366648 / — / no baseline 0.74 / — / no baseline
job_q74/duckdb:duckdb 62645248 / — / no baseline 87638490 / — / no baseline 0.71 / — / no baseline
job_q75/duckdb:duckdb 55577734 / — / no baseline 80295508 / — / no baseline 0.69 / — / no baseline
job_q76/duckdb:duckdb 25311946 / — / no baseline 44415280 / — / no baseline 0.57 / — / no baseline
job_q77/duckdb:duckdb 23816186 / — / no baseline 36729443 / — / no baseline 0.65 / — / no baseline
job_q78/duckdb:duckdb 25837678 / — / no baseline 43631026 / — / no baseline 0.59 / — / no baseline
job_q79/duckdb:duckdb 64008665 / — / no baseline 81695325 / — / no baseline 0.78 / — / no baseline
job_q80/duckdb:duckdb 47160176 / — / no baseline 65149891 / — / no baseline 0.72 / — / no baseline
job_q81/duckdb:duckdb 103374561 / — / no baseline 123272774 / — / no baseline 0.84 / — / no baseline
job_q82/duckdb:duckdb 144664518 / — / no baseline 163245487 / — / no baseline 0.89 / — / no baseline
job_q83/duckdb:duckdb 48594382 / — / no baseline 65051667 / — / no baseline 0.75 / — / no baseline
job_q84/duckdb:duckdb 27108864 / — / no baseline 42263428 / — / no baseline 0.64 / — / no baseline
job_q85/duckdb:duckdb 49670260 / — / no baseline 67031424 / — / no baseline 0.74 / — / no baseline
job_q86/duckdb:duckdb 54850008 / — / no baseline 79422505 / — / no baseline 0.69 / — / no baseline
job_q87/duckdb:duckdb 32735714 / — / no baseline 55289588 / — / no baseline 0.59 / — / no baseline
job_q88/duckdb:duckdb 49301552 / — / no baseline 79627544 / — / no baseline 0.62 / — / no baseline
job_q89/duckdb:duckdb 27113656 / — / no baseline 49218861 / — / no baseline 0.55 / — / no baseline
job_q90/duckdb:duckdb 59062410 / — / no baseline 88159634 / — / no baseline 0.67 / — / no baseline
job_q91/duckdb:duckdb 54059854 / — / no baseline 87164620 / — / no baseline 0.62 / — / no baseline
job_q92/duckdb:duckdb 34675024 / — / no baseline 63114674 / — / no baseline 0.55 / — / no baseline
job_q93/duckdb:duckdb 78971743 / — / no baseline 108529842 / — / no baseline 0.73 / — / no baseline
job_q94/duckdb:duckdb 23524746 / — / no baseline 38062855 / — / no baseline 0.62 / — / no baseline
job_q95/duckdb:duckdb 22088626 / — / no baseline 36132360 / — / no baseline 0.61 / — / no baseline
job_q96/duckdb:duckdb 24120908 / — / no baseline 38784134 / — / no baseline 0.62 / — / no baseline
job_q97/duckdb:duckdb 85660902 / — / no baseline 105073390 / — / no baseline 0.82 / — / no baseline
job_q98/duckdb:duckdb 46011358 / — / no baseline 63820008 / — / no baseline 0.72 / — / no baseline
job_q99/duckdb:duckdb 77914949 / — / no baseline 96250696 / — / no baseline 0.81 / — / no baseline

No baseline file sizes found for base commit.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ab06f552 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 0.997x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.3% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21140943 / 20733386 / +2.0% 39274829 / 37898364 / +3.6% 0.54 / 0.55 / -1.6%
tpcds_q02/datafusion:vortex-file-compressed 44602740 / 44598960 / +0.0% 67085493 / 66117904 / +1.5% 0.66 / 0.67 / -1.4%
tpcds_q03/datafusion:vortex-file-compressed 11297346 / 11050390 / +2.2% 29068383 / 27604835 / +5.3% 0.39 / 0.40 / -2.9%
tpcds_q04/datafusion:vortex-file-compressed 87880393 / 86571132 / +1.5% 118271795 / 120044062 / -1.5% 0.74 / 0.72 / +3.0%
tpcds_q05/datafusion:vortex-file-compressed 56697246 / 57285720 / -1.0% 76861387 / 80336494 / -4.3% 0.74 / 0.71 / +3.4%
tpcds_q06/datafusion:vortex-file-compressed 22154820 / 22599756 / -2.0% 41784245 / 42640021 / -2.0% 0.53 / 0.53 / +0.0%
tpcds_q07/datafusion:vortex-file-compressed 28792356 / 28661319 / +0.5% 51930235 / 50655585 / +2.5% 0.55 / 0.57 / -2.0%
tpcds_q08/datafusion:vortex-file-compressed 24277500 / 24656304 / -1.5% 43721949 / 42141476 / +3.8% 0.56 / 0.59 / -5.1%
tpcds_q09/datafusion:vortex-file-compressed 21421734 / 21464403 / -0.2% 36813685 / 36615229 / +0.5% 0.58 / 0.59 / -0.7%
tpcds_q10/datafusion:vortex-file-compressed 27281826 / 26852893 / +1.6% 49575798 / 50655103 / -2.1% 0.55 / 0.53 / +3.8%
tpcds_q11/datafusion:vortex-file-compressed 53299855 / 51527342 / +3.4% 82454872 / 82579416 / -0.2% 0.65 / 0.62 / +3.6%
tpcds_q12/datafusion:vortex-file-compressed 14847964 / 14636198 / +1.4% 31719509 / 30614475 / +3.6% 0.47 / 0.48 / -2.1%
tpcds_q13/datafusion:vortex-file-compressed 33266542 / 31614171 / +5.2% 59503336 / 59153209 / +0.6% 0.56 / 0.53 / +4.6%
tpcds_q14/datafusion:vortex-file-compressed 489663652 / 487961152 / +0.3% 549888240 / 546353754 / +0.6% 0.89 / 0.89 / -0.3%
tpcds_q15/datafusion:vortex-file-compressed 12326350 / 12329716 / -0.0% 32380341 / 33858081 / -4.4% 0.38 / 0.36 / +4.5%
tpcds_q16/datafusion:vortex-file-compressed 18460192 / 18360156 / +0.5% 39229138 / 39096177 / +0.3% 0.47 / 0.47 / +0.2%
tpcds_q17/datafusion:vortex-file-compressed 54675214 / 51506156 / +6.2% 67084742 / 68220914 / -1.7% 0.82 / 0.75 / +8.0%
tpcds_q18/datafusion:vortex-file-compressed 63880968 / 63016694 / +1.4% 85917236 / 84865200 / +1.2% 0.74 / 0.74 / +0.1%
tpcds_q19/datafusion:vortex-file-compressed 16887499 / 16810344 / +0.5% 37485536 / 39004217 / -3.9% 0.45 / 0.43 / +4.5%
tpcds_q20/datafusion:vortex-file-compressed 16136088 / 16566498 / -2.6% 35926435 / 35364819 / +1.6% 0.45 / 0.47 / -4.1%
tpcds_q21/datafusion:vortex-file-compressed 16143093 / 16289557 / -0.9% 40240306 / 39963040 / +0.7% 0.40 / 0.41 / -1.6%
tpcds_q22/datafusion:vortex-file-compressed 49277703 / 49340566 / -0.1% 72328033 / 73376032 / -1.4% 0.68 / 0.67 / +1.3%
tpcds_q23/datafusion:vortex-file-compressed 71063394 / 71061683 / +0.0% 96882984 / 98663105 / -1.8% 0.73 / 0.72 / +1.8%
tpcds_q24/datafusion:vortex-file-compressed 64803246 / 65604674 / -1.2% 86799130 / 89143063 / -2.6% 0.75 / 0.74 / +1.4%
tpcds_q25/datafusion:vortex-file-compressed 47432846 / 48693758 / -2.6% 74009589 / 74852028 / -1.1% 0.64 / 0.65 / -1.5%
tpcds_q26/datafusion:vortex-file-compressed 26048571 / 25713595 / +1.3% 47073612 / 46597632 / +1.0% 0.55 / 0.55 / +0.3%
tpcds_q27/datafusion:vortex-file-compressed 59969250 / 58366971 / +2.7% 78865589 / 80314594 / -1.8% 0.76 / 0.73 / +4.6%
tpcds_q28/datafusion:vortex-file-compressed 27320028 / 25425050 / +7.5% 42022508 / 40408486 / +4.0% 0.65 / 0.63 / +3.3%
tpcds_q29/datafusion:vortex-file-compressed 54571975 / 53720846 / +1.6% 77095048 / 69237454 / +11.3% 🔴 0.71 / 0.78 / -8.8%
tpcds_q30/datafusion:vortex-file-compressed 26091885 / 26355720 / -1.0% 44666259 / 44519345 / +0.3% 0.58 / 0.59 / -1.3%
tpcds_q31/datafusion:vortex-file-compressed 58447080 / 58098146 / +0.6% 84318707 / 84193801 / +0.1% 0.69 / 0.69 / +0.5%
tpcds_q32/datafusion:vortex-file-compressed 12641150 / 12213186 / +3.5% 30440532 / 30918635 / -1.5% 0.42 / 0.40 / +5.1%
tpcds_q33/datafusion:vortex-file-compressed 27292140 / 27022812 / +1.0% 50375836 / 49494795 / +1.8% 0.54 / 0.55 / -0.8%
tpcds_q34/datafusion:vortex-file-compressed 17642560 / 17380562 / +1.5% 36301237 / 36016999 / +0.8% 0.49 / 0.48 / +0.7%
tpcds_q35/datafusion:vortex-file-compressed 30160205 / 30117882 / +0.1% 55411616 / 55660880 / -0.4% 0.54 / 0.54 / +0.6%
tpcds_q36/datafusion:vortex-file-compressed 47110613 / 46557302 / +1.2% 71150587 / 70266296 / +1.3% 0.66 / 0.66 / -0.1%
tpcds_q37/datafusion:vortex-file-compressed 11989438 / 11994987 / -0.0% 32794272 / 34361470 / -4.6% 0.37 / 0.35 / +4.7%
tpcds_q38/datafusion:vortex-file-compressed 25538572 / 25207374 / +1.3% 47966133 / 46567092 / +3.0% 0.53 / 0.54 / -1.6%
tpcds_q39/datafusion:vortex-file-compressed 65054536 / 65181855 / -0.2% 90042018 / 90315646 / -0.3% 0.72 / 0.72 / +0.1%
tpcds_q40/datafusion:vortex-file-compressed 23751076 / 23662816 / +0.4% 43214995 / 43755464 / -1.2% 0.55 / 0.54 / +1.6%
tpcds_q41/datafusion:vortex-file-compressed 20528732 / 20222424 / +1.5% 34184664 / 33228585 / +2.9% 0.60 / 0.61 / -1.3%
tpcds_q42/datafusion:vortex-file-compressed 10851658 / 10884046 / -0.3% 27084787 / 26678100 / +1.5% 0.40 / 0.41 / -1.8%
tpcds_q43/datafusion:vortex-file-compressed 12474658 / 12396382 / +0.6% 30888147 / 32532508 / -5.1% 0.40 / 0.38 / +6.0%
tpcds_q44/datafusion:vortex-file-compressed 28823709 / 28977903 / -0.5% 53516669 / 55434515 / -3.5% 0.54 / 0.52 / +3.0%
tpcds_q45/datafusion:vortex-file-compressed 15991694 / 15860720 / +0.8% 34697364 / 33993879 / +2.1% 0.46 / 0.47 / -1.2%
tpcds_q46/datafusion:vortex-file-compressed 23473759 / 23140603 / +1.4% 44975066 / 46000388 / -2.2% 0.52 / 0.50 / +3.8%
tpcds_q47/datafusion:vortex-file-compressed 75187608 / 75125307 / +0.1% 104810731 / 103937023 / +0.8% 0.72 / 0.72 / -0.8%
tpcds_q48/datafusion:vortex-file-compressed 28631181 / 28702510 / -0.2% 52987217 / 52123560 / +1.7% 0.54 / 0.55 / -1.9%
tpcds_q49/datafusion:vortex-file-compressed 57949888 / 56560460 / +2.5% 80488753 / 78742842 / +2.2% 0.72 / 0.72 / +0.2%
tpcds_q50/datafusion:vortex-file-compressed 30166234 / 30253786 / -0.3% 51597943 / 55124960 / -6.4% 0.58 / 0.55 / +6.5%
tpcds_q51/datafusion:vortex-file-compressed 66187074 / 66663678 / -0.7% 88117794 / 87595330 / +0.6% 0.75 / 0.76 / -1.3%
tpcds_q52/datafusion:vortex-file-compressed 11392764 / 11361022 / +0.3% 28418067 / 28041797 / +1.3% 0.40 / 0.41 / -1.0%
tpcds_q53/datafusion:vortex-file-compressed 17883358 / 17907294 / -0.1% 38363143 / 38209947 / +0.4% 0.47 / 0.47 / -0.5%
tpcds_q54/datafusion:vortex-file-compressed 31417376 / 31347957 / +0.2% 53224461 / 55223552 / -3.6% 0.59 / 0.57 / +4.0%
tpcds_q55/datafusion:vortex-file-compressed 10824215 / 10950064 / -1.1% 28308600 / 29043319 / -2.5% 0.38 / 0.38 / +1.4%
tpcds_q56/datafusion:vortex-file-compressed 26767089 / 26538242 / +0.9% 47968706 / 46777034 / +2.5% 0.56 / 0.57 / -1.6%
tpcds_q57/datafusion:vortex-file-compressed 62256155 / 62197480 / +0.1% 88349301 / 87770658 / +0.7% 0.70 / 0.71 / -0.6%
tpcds_q58/datafusion:vortex-file-compressed 38324180 / 38229555 / +0.2% 62393713 / 63678321 / -2.0% 0.61 / 0.60 / +2.3%
tpcds_q59/datafusion:vortex-file-compressed 30074689 / 29798868 / +0.9% 53965574 / 57177960 / -5.6% 0.56 / 0.52 / +6.9%
tpcds_q60/datafusion:vortex-file-compressed 25706186 / 26209728 / -1.9% 46404056 / 46698223 / -0.6% 0.55 / 0.56 / -1.3%
tpcds_q61/datafusion:vortex-file-compressed 21715498 / 21951628 / -1.1% 43704127 / 43968525 / -0.6% 0.50 / 0.50 / -0.5%
tpcds_q62/datafusion:vortex-file-compressed 16462703 / 16008094 / +2.8% 35048368 / 35203307 / -0.4% 0.47 / 0.45 / +3.3%
tpcds_q63/datafusion:vortex-file-compressed 17835530 / 17673858 / +0.9% 38012207 / 38322144 / -0.8% 0.47 / 0.46 / +1.7%
tpcds_q64/datafusion:vortex-file-compressed 211680830 / 211929682 / -0.1% 249977407 / 254984276 / -2.0% 0.85 / 0.83 / +1.9%
tpcds_q65/datafusion:vortex-file-compressed 72742410 / 73507852 / -1.0% 94749556 / 92726813 / +2.2% 0.77 / 0.79 / -3.2%
tpcds_q66/datafusion:vortex-file-compressed 50268342 / 50128762 / +0.3% 73654288 / 73402845 / +0.3% 0.68 / 0.68 / -0.1%
tpcds_q67/datafusion:vortex-file-compressed 50970615 / 50860379 / +0.2% 82738587 / 81893433 / +1.0% 0.62 / 0.62 / -0.8%
tpcds_q68/datafusion:vortex-file-compressed 22776132 / 22662279 / +0.5% 46084503 / 46116634 / -0.1% 0.49 / 0.49 / +0.6%
tpcds_q69/datafusion:vortex-file-compressed 25317716 / 24922431 / +1.6% 48323401 / 48439163 / -0.2% 0.52 / 0.51 / +1.8%
tpcds_q70/datafusion:vortex-file-compressed 71025052 / 71495672 / -0.7% 92264808 / 93023206 / -0.8% 0.77 / 0.77 / +0.2%
tpcds_q71/datafusion:vortex-file-compressed 18973108 / 18999078 / -0.1% 39186936 / 40045681 / -2.1% 0.48 / 0.47 / +2.1%
tpcds_q72/datafusion:vortex-file-compressed 351630770 / 350729840 / +0.3% 386413891 / 436904113 / -11.6% 🟢 0.91 / 0.80 / +13.4%
tpcds_q73/datafusion:vortex-file-compressed 16331413 / 15943848 / +2.4% 35367138 / 34747953 / +1.8% 0.46 / 0.46 / +0.6%
tpcds_q74/datafusion:vortex-file-compressed 40786780 / 40712296 / +0.2% 66997323 / 65712465 / +2.0% 0.61 / 0.62 / -1.7%
tpcds_q75/datafusion:vortex-file-compressed 140069482 / 137942058 / +1.5% 158674289 / 165091504 / -3.9% 0.88 / 0.84 / +5.6%
tpcds_q76/datafusion:vortex-file-compressed 29804437 / 29089978 / +2.5% 50699421 / 49726679 / +2.0% 0.59 / 0.58 / +0.5%
tpcds_q77/datafusion:vortex-file-compressed 46738830 / 45785582 / +2.1% 66320203 / 66941313 / -0.9% 0.70 / 0.68 / +3.0%
tpcds_q78/datafusion:vortex-file-compressed 64118982 / 64057638 / +0.1% 92642462 / 93344870 / -0.8% 0.69 / 0.69 / +0.9%
tpcds_q79/datafusion:vortex-file-compressed 19891941 / 19653164 / +1.2% 42984333 / 40270669 / +6.7% 0.46 / 0.49 / -5.2%
tpcds_q80/datafusion:vortex-file-compressed 73490462 / 74242991 / -1.0% 103534590 / 102492708 / +1.0% 0.71 / 0.72 / -2.0%
tpcds_q81/datafusion:vortex-file-compressed 26340440 / 26288874 / +0.2% 44363281 / 44925990 / -1.3% 0.59 / 0.59 / +1.5%
tpcds_q82/datafusion:vortex-file-compressed 12182801 / 11657616 / +4.5% 33055988 / 34482515 / -4.1% 0.37 / 0.34 / +9.0%
tpcds_q83/datafusion:vortex-file-compressed 32776679 / 32845756 / -0.2% 52064772 / 54001225 / -3.6% 0.63 / 0.61 / +3.5%
tpcds_q84/datafusion:vortex-file-compressed 9913136 / 10213946 / -2.9% 26008089 / 26737182 / -2.7% 0.38 / 0.38 / -0.2%
tpcds_q85/datafusion:vortex-file-compressed 53979073 / 53550482 / +0.8% 79308424 / 82414221 / -3.8% 0.68 / 0.65 / +4.7%
tpcds_q86/datafusion:vortex-file-compressed 15923094 / 15917954 / +0.0% 33916998 / 35350512 / -4.1% 0.47 / 0.45 / +4.3%
tpcds_q87/datafusion:vortex-file-compressed 25980161 / 25193846 / +3.1% 49274087 / 49114668 / +0.3% 0.53 / 0.51 / +2.8%
tpcds_q88/datafusion:vortex-file-compressed 31291131 / 31267540 / +0.1% 52900897 / 49825733 / +6.2% 0.59 / 0.63 / -5.7%
tpcds_q89/datafusion:vortex-file-compressed 21077006 / 21043659 / +0.2% 43494105 / 41565206 / +4.6% 0.48 / 0.51 / -4.3%
tpcds_q90/datafusion:vortex-file-compressed 9985133 / 10029754 / -0.4% 26009851 / 25562663 / +1.7% 0.38 / 0.39 / -2.2%
tpcds_q91/datafusion:vortex-file-compressed 16760038 / 16941366 / -1.1% 36441487 / 36674489 / -0.6% 0.46 / 0.46 / -0.4%
tpcds_q92/datafusion:vortex-file-compressed 13054566 / 12976229 / +0.6% 28403684 / 29415937 / -3.4% 0.46 / 0.44 / +4.2%
tpcds_q93/datafusion:vortex-file-compressed 20345620 / 20578862 / -1.1% 41223150 / 39357759 / +4.7% 0.49 / 0.52 / -5.6%
tpcds_q94/datafusion:vortex-file-compressed 18881725 / 18260008 / +3.4% 36602857 / 37194437 / -1.6% 0.52 / 0.49 / +5.1%
tpcds_q95/datafusion:vortex-file-compressed 42351698 / 42348262 / +0.0% 63273302 / 63473700 / -0.3% 0.67 / 0.67 / +0.3%
tpcds_q96/datafusion:vortex-file-compressed 7464243 / 7489094 / -0.3% 24653277 / 25376481 / -2.8% 0.30 / 0.30 / +2.6%
tpcds_q97/datafusion:vortex-file-compressed 17152442 / 16916140 / +1.4% 37124430 / 38813840 / -4.4% 0.46 / 0.44 / +6.0%
tpcds_q98/datafusion:vortex-file-compressed 16086049 / 16652057 / -3.4% 38231389 / 38365755 / -0.4% 0.42 / 0.43 / -3.1%
tpcds_q99/datafusion:vortex-file-compressed 16001845 / 16029014 / -0.2% 35857813 / 34677412 / +3.4% 0.45 / 0.46 / -3.5%
datafusion / vortex-compact / ns (1.007x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-compact 21568559 / 20911404 / +3.1% 38892316 / 39071125 / -0.5% 0.55 / 0.54 / +3.6%
tpcds_q02/datafusion:vortex-compact 44499338 / 44997237 / -1.1% 65906005 / 67352154 / -2.1% 0.68 / 0.67 / +1.1%
tpcds_q03/datafusion:vortex-compact 11418276 / 11582382 / -1.4% 32290140 / 30649438 / +5.4% 0.35 / 0.38 / -6.4%
tpcds_q04/datafusion:vortex-compact 93032759 / 93189699 / -0.2% 122542458 / 126650874 / -3.2% 0.76 / 0.74 / +3.2%
tpcds_q05/datafusion:vortex-compact 57971488 / 56436074 / +2.7% 80176345 / 80577326 / -0.5% 0.72 / 0.70 / +3.2%
tpcds_q06/datafusion:vortex-compact 23060251 / 23511634 / -1.9% 45010858 / 44811379 / +0.4% 0.51 / 0.52 / -2.4%
tpcds_q07/datafusion:vortex-compact 31500446 / 31100082 / +1.3% 52131198 / 51780612 / +0.7% 0.60 / 0.60 / +0.6%
tpcds_q08/datafusion:vortex-compact 26506642 / 27474516 / -3.5% 46196885 / 46760934 / -1.2% 0.57 / 0.59 / -2.3%
tpcds_q09/datafusion:vortex-compact 23013130 / 22529448 / +2.1% 41752676 / 41274997 / +1.2% 0.55 / 0.55 / +1.0%
tpcds_q10/datafusion:vortex-compact 30085938 / 29374846 / +2.4% 52368113 / 51883108 / +0.9% 0.57 / 0.57 / +1.5%
tpcds_q11/datafusion:vortex-compact 57334935 / 55634350 / +3.1% 89453846 / 83242751 / +7.5% 0.64 / 0.67 / -4.1%
tpcds_q12/datafusion:vortex-compact 19319076 / 18860254 / +2.4% 37324253 / 37751149 / -1.1% 0.52 / 0.50 / +3.6%
tpcds_q13/datafusion:vortex-compact 48530670 / 48836567 / -0.6% 68132112 / 69180057 / -1.5% 0.71 / 0.71 / +0.9%
tpcds_q14/datafusion:vortex-compact 636385200 / 633313662 / +0.5% 695561729 / 699177726 / -0.5% 0.91 / 0.91 / +1.0%
tpcds_q15/datafusion:vortex-compact 13748542 / 13836676 / -0.6% 33998556 / 33757712 / +0.7% 0.40 / 0.41 / -1.3%
tpcds_q16/datafusion:vortex-compact 19647137 / 18980382 / +3.5% 40136716 / 40110323 / +0.1% 0.49 / 0.47 / +3.4%
tpcds_q17/datafusion:vortex-compact 58417992 / 50971664 / +14.6% 🔴 74685517 / 72764264 / +2.6% 0.78 / 0.70 / +11.7%
tpcds_q18/datafusion:vortex-compact 61469411 / 60766751 / +1.2% 81346881 / 81663697 / -0.4% 0.76 / 0.74 / +1.6%
tpcds_q19/datafusion:vortex-compact 18982048 / 18921312 / +0.3% 41462120 / 41540068 / -0.2% 0.46 / 0.46 / +0.5%
tpcds_q20/datafusion:vortex-compact 19522700 / 20579890 / -5.1% 41405700 / 41650012 / -0.6% 0.47 / 0.49 / -4.6%
tpcds_q21/datafusion:vortex-compact 17431222 / 17611726 / -1.0% 40228839 / 39878568 / +0.9% 0.43 / 0.44 / -1.9%
tpcds_q22/datafusion:vortex-compact 48926983 / 49845009 / -1.8% 73242399 / 73864771 / -0.8% 0.67 / 0.67 / -1.0%
tpcds_q23/datafusion:vortex-compact 73968819 / 72629038 / +1.8% 96480084 / 98163657 / -1.7% 0.77 / 0.74 / +3.6%
tpcds_q24/datafusion:vortex-compact 72108930 / 71822984 / +0.4% 94061647 / 95408017 / -1.4% 0.77 / 0.75 / +1.8%
tpcds_q25/datafusion:vortex-compact 51171671 / 51764055 / -1.1% 75735649 / 85852273 / -11.8% 🟢 0.68 / 0.60 / +12.1%
tpcds_q26/datafusion:vortex-compact 28215258 / 27885336 / +1.2% 48050581 / 46792260 / +2.7% 0.59 / 0.60 / -1.5%
tpcds_q27/datafusion:vortex-compact 59216625 / 58557400 / +1.1% 83309941 / 78371544 / +6.3% 0.71 / 0.75 / -4.9%
tpcds_q28/datafusion:vortex-compact 26413944 / 27246252 / -3.1% 44970589 / 46029127 / -2.3% 0.59 / 0.59 / -0.8%
tpcds_q29/datafusion:vortex-compact 57323096 / 52760370 / +8.6% 81324424 / 79339062 / +2.5% 0.70 / 0.66 / +6.0%
tpcds_q30/datafusion:vortex-compact 27768441 / 27682037 / +0.3% 46562791 / 46252291 / +0.7% 0.60 / 0.60 / -0.4%
tpcds_q31/datafusion:vortex-compact 61312238 / 60972601 / +0.6% 86262332 / 87495473 / -1.4% 0.71 / 0.70 / +2.0%
tpcds_q32/datafusion:vortex-compact 13422950 / 13688596 / -1.9% 32639104 / 33016353 / -1.1% 0.41 / 0.41 / -0.8%
tpcds_q33/datafusion:vortex-compact 27860784 / 27612786 / +0.9% 51465010 / 52270692 / -1.5% 0.54 / 0.53 / +2.5%
tpcds_q34/datafusion:vortex-compact 18747743 / 18613696 / +0.7% 35476344 / 39328122 / -9.8% 0.53 / 0.47 / +11.7%
tpcds_q35/datafusion:vortex-compact 33701881 / 33230442 / +1.4% 57285344 / 56559971 / +1.3% 0.59 / 0.59 / +0.1%
tpcds_q36/datafusion:vortex-compact 49528026 / 50138367 / -1.2% 74683292 / 73325368 / +1.9% 0.66 / 0.68 / -3.0%
tpcds_q37/datafusion:vortex-compact 14891146 / 14314550 / +4.0% 36522097 / 37483529 / -2.6% 0.41 / 0.38 / +6.8%
tpcds_q38/datafusion:vortex-compact 26137899 / 26006011 / +0.5% 48901879 / 47605527 / +2.7% 0.53 / 0.55 / -2.2%
tpcds_q39/datafusion:vortex-compact 65842484 / 67068193 / -1.8% 89054761 / 89002712 / +0.1% 0.74 / 0.75 / -1.9%
tpcds_q40/datafusion:vortex-compact 24201263 / 23952694 / +1.0% 47269065 / 47639286 / -0.8% 0.51 / 0.50 / +1.8%
tpcds_q41/datafusion:vortex-compact 20646571 / 20752080 / -0.5% 34900963 / 35945880 / -2.9% 0.59 / 0.58 / +2.5%
tpcds_q42/datafusion:vortex-compact 11200034 / 11390685 / -1.7% 28995933 / 31810375 / -8.8% 0.39 / 0.36 / +7.9%
tpcds_q43/datafusion:vortex-compact 13369773 / 13263854 / +0.8% 32070510 / 31271241 / +2.6% 0.42 / 0.42 / -1.7%
tpcds_q44/datafusion:vortex-compact 28425522 / 28130782 / +1.0% 50860439 / 50719740 / +0.3% 0.56 / 0.55 / +0.8%
tpcds_q45/datafusion:vortex-compact 17773780 / 17988404 / -1.2% 38494219 / 37043003 / +3.9% 0.46 / 0.49 / -4.9%
tpcds_q46/datafusion:vortex-compact 25901741 / 24423338 / +6.1% 46518186 / 47981053 / -3.0% 0.56 / 0.51 / +9.4%
tpcds_q47/datafusion:vortex-compact 79621032 / 79258136 / +0.5% 109424558 / 111364010 / -1.7% 0.73 / 0.71 / +2.2%
tpcds_q48/datafusion:vortex-compact 45174080 / 43874226 / +3.0% 63091849 / 64645149 / -2.4% 0.72 / 0.68 / +5.5%
tpcds_q49/datafusion:vortex-compact 59520520 / 60014826 / -0.8% 83314728 / 85133950 / -2.1% 0.71 / 0.70 / +1.3%
tpcds_q50/datafusion:vortex-compact 31311474 / 32564450 / -3.8% 51495097 / 52011903 / -1.0% 0.61 / 0.63 / -2.9%
tpcds_q51/datafusion:vortex-compact 66649286 / 66669418 / -0.0% 86378234 / 88152305 / -2.0% 0.77 / 0.76 / +2.0%
tpcds_q52/datafusion:vortex-compact 11761806 / 11661798 / +0.9% 31095673 / 30846824 / +0.8% 0.38 / 0.38 / +0.1%
tpcds_q53/datafusion:vortex-compact 20806688 / 20388278 / +2.1% 42460349 / 44669420 / -4.9% 0.49 / 0.46 / +7.4%
tpcds_q54/datafusion:vortex-compact 33947149 / 33394130 / +1.7% 58677635 / 59629922 / -1.6% 0.58 / 0.56 / +3.3%
tpcds_q55/datafusion:vortex-compact 10985854 / 10797694 / +1.7% 30881014 / 30705073 / +0.6% 0.36 / 0.35 / +1.2%
tpcds_q56/datafusion:vortex-compact 26717001 / 25947506 / +3.0% 49834387 / 48146943 / +3.5% 0.54 / 0.54 / -0.5%
tpcds_q57/datafusion:vortex-compact 65543134 / 65977760 / -0.7% 93319268 / 92592706 / +0.8% 0.70 / 0.71 / -1.4%
tpcds_q58/datafusion:vortex-compact 41453776 / 41764404 / -0.7% 69556112 / 67476135 / +3.1% 0.60 / 0.62 / -3.7%
tpcds_q59/datafusion:vortex-compact 31942849 / 31595738 / +1.1% 55285475 / 55627240 / -0.6% 0.58 / 0.57 / +1.7%
tpcds_q60/datafusion:vortex-compact 26280032 / 26225991 / +0.2% 49228194 / 48713186 / +1.1% 0.53 / 0.54 / -0.8%
tpcds_q61/datafusion:vortex-compact 23277984 / 23032380 / +1.1% 43301271 / 41819541 / +3.5% 0.54 / 0.55 / -2.4%
tpcds_q62/datafusion:vortex-compact 17226103 / 16680992 / +3.3% 34891224 / 35135592 / -0.7% 0.49 / 0.47 / +4.0%
tpcds_q63/datafusion:vortex-compact 20792463 / 20764446 / +0.1% 41949185 / 41800732 / +0.4% 0.50 / 0.50 / -0.2%
tpcds_q64/datafusion:vortex-compact 304163580 / 304107212 / +0.0% 336039931 / 336981821 / -0.3% 0.91 / 0.90 / +0.3%
tpcds_q65/datafusion:vortex-compact 77229959 / 76047472 / +1.6% 96700596 / 99378700 / -2.7% 0.80 / 0.77 / +4.4%
tpcds_q66/datafusion:vortex-compact 51298034 / 51111786 / +0.4% 75225059 / 73779203 / +2.0% 0.68 / 0.69 / -1.6%
tpcds_q67/datafusion:vortex-compact 52393798 / 52270741 / +0.2% 86098962 / 84175745 / +2.3% 0.61 / 0.62 / -2.0%
tpcds_q68/datafusion:vortex-compact 26538476 / 24562692 / +8.0% 47584177 / 48411688 / -1.7% 0.56 / 0.51 / +9.9%
tpcds_q69/datafusion:vortex-compact 28557204 / 29238814 / -2.3% 49553881 / 51316694 / -3.4% 0.58 / 0.57 / +1.1%
tpcds_q70/datafusion:vortex-compact 71503886 / 71630369 / -0.2% 94995131 / 94573961 / +0.4% 0.75 / 0.76 / -0.6%
tpcds_q71/datafusion:vortex-compact 19823836 / 20754126 / -4.5% 38905578 / 39178888 / -0.7% 0.51 / 0.53 / -3.8%
tpcds_q72/datafusion:vortex-compact 358730008 / 360730164 / -0.6% 393877461 / 387663106 / +1.6% 0.91 / 0.93 / -2.1%
tpcds_q73/datafusion:vortex-compact 17125620 / 17699599 / -3.2% 38209944 / 36689584 / +4.1% 0.45 / 0.48 / -7.1%
tpcds_q74/datafusion:vortex-compact 41938660 / 42100962 / -0.4% 69553129 / 69056790 / +0.7% 0.60 / 0.61 / -1.1%
tpcds_q75/datafusion:vortex-compact 141417742 / 144115940 / -1.9% 172172180 / 177533317 / -3.0% 0.82 / 0.81 / +1.2%
tpcds_q76/datafusion:vortex-compact 30330805 / 30223414 / +0.4% 50165594 / 49623097 / +1.1% 0.60 / 0.61 / -0.7%
tpcds_q77/datafusion:vortex-compact 46220197 / 46263164 / -0.1% 67245235 / 66361782 / +1.3% 0.69 / 0.70 / -1.4%
tpcds_q78/datafusion:vortex-compact 66146428 / 66556948 / -0.6% 91204004 / 92980358 / -1.9% 0.73 / 0.72 / +1.3%
tpcds_q79/datafusion:vortex-compact 21298142 / 21189326 / +0.5% 43437273 / 42542256 / +2.1% 0.49 / 0.50 / -1.6%
tpcds_q80/datafusion:vortex-compact 75733114 / 74841214 / +1.2% 104054868 / 104062937 / -0.0% 0.73 / 0.72 / +1.2%
tpcds_q81/datafusion:vortex-compact 26802783 / 26579904 / +0.8% 45195201 / 46249846 / -2.3% 0.59 / 0.57 / +3.2%
tpcds_q82/datafusion:vortex-compact 14284396 / 13798898 / +3.5% 36163767 / 35739130 / +1.2% 0.39 / 0.39 / +2.3%
tpcds_q83/datafusion:vortex-compact 32355046 / 32623672 / -0.8% 55062925 / 51573367 / +6.8% 0.59 / 0.63 / -7.1%
tpcds_q84/datafusion:vortex-compact 11482012 / 11275494 / +1.8% 26352997 / 27750651 / -5.0% 0.44 / 0.41 / +7.2%
tpcds_q85/datafusion:vortex-compact 96658942 / 100163223 / -3.5% 122021141 / 121824670 / +0.2% 0.79 / 0.82 / -3.7%
tpcds_q86/datafusion:vortex-compact 15592056 / 15757728 / -1.1% 33817307 / 34740459 / -2.7% 0.46 / 0.45 / +1.6%
tpcds_q87/datafusion:vortex-compact 26179416 / 26019712 / +0.6% 48747497 / 47419891 / +2.8% 0.54 / 0.55 / -2.1%
tpcds_q88/datafusion:vortex-compact 36074500 / 35518035 / +1.6% 58942493 / 58127326 / +1.4% 0.61 / 0.61 / +0.2%
tpcds_q89/datafusion:vortex-compact 23169814 / 23047714 / +0.5% 45685415 / 44990473 / +1.5% 0.51 / 0.51 / -1.0%
tpcds_q90/datafusion:vortex-compact 10572616 / 10554532 / +0.2% 26173467 / 26121111 / +0.2% 0.40 / 0.40 / -0.0%
tpcds_q91/datafusion:vortex-compact 24875022 / 23736920 / +4.8% 44158895 / 44495981 / -0.8% 0.56 / 0.53 / +5.6%
tpcds_q92/datafusion:vortex-compact 13788990 / 13568503 / +1.6% 30870802 / 30354016 / +1.7% 0.45 / 0.45 / -0.1%
tpcds_q93/datafusion:vortex-compact 20413186 / 20765580 / -1.7% 41524436 / 39726824 / +4.5% 0.49 / 0.52 / -6.0%
tpcds_q94/datafusion:vortex-compact 19734808 / 19100299 / +3.3% 38699194 / 37767014 / +2.5% 0.51 / 0.51 / +0.8%
tpcds_q95/datafusion:vortex-compact 43164804 / 42920006 / +0.6% 63991838 / 62669588 / +2.1% 0.67 / 0.68 / -1.5%
tpcds_q96/datafusion:vortex-compact 8541878 / 8342354 / +2.4% 25492251 / 26281222 / -3.0% 0.34 / 0.32 / +5.6%
tpcds_q97/datafusion:vortex-compact 17664922 / 16942188 / +4.3% 37747841 / 36943585 / +2.2% 0.47 / 0.46 / +2.0%
tpcds_q98/datafusion:vortex-compact 20873230 / 20868574 / +0.0% 40532125 / 42544514 / -4.7% 0.51 / 0.49 / +5.0%
tpcds_q99/datafusion:vortex-compact 16930368 / 16679994 / +1.5% 35786514 / 36079445 / -0.8% 0.47 / 0.46 / +2.3%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42081506 / 43180467 / -2.5% 59780935 / 61295669 / -2.5% 0.70 / 0.70 / -0.1%
tpcds_q02/datafusion:parquet 54832984 / 54974062 / -0.3% 72599970 / 71506377 / +1.5% 0.76 / 0.77 / -1.8%
tpcds_q03/datafusion:parquet 19103670 / 18915220 / +1.0% 32238425 / 34922192 / -7.7% 0.59 / 0.54 / +9.4%
tpcds_q04/datafusion:parquet 182071034 / 182320230 / -0.1% 206552926 / 206891215 / -0.2% 0.88 / 0.88 / +0.0%
tpcds_q05/datafusion:parquet 68255680 / 68459924 / -0.3% 89971060 / 91309261 / -1.5% 0.76 / 0.75 / +1.2%
tpcds_q06/datafusion:parquet 33668864 / 34001035 / -1.0% 47996140 / 49774645 / -3.6% 0.70 / 0.68 / +2.7%
tpcds_q07/datafusion:parquet 47002673 / 46795359 / +0.4% 67454885 / 65979939 / +2.2% 0.70 / 0.71 / -1.8%
tpcds_q08/datafusion:parquet 31492594 / 31375564 / +0.4% 44667296 / 46211105 / -3.3% 0.71 / 0.68 / +3.8%
tpcds_q09/datafusion:parquet 32791081 / 32003948 / +2.5% 38928391 / 43780453 / -11.1% 🟢 0.84 / 0.73 / +15.2%
tpcds_q10/datafusion:parquet 44716009 / 43827356 / +2.0% 58026879 / 59829263 / -3.0% 0.77 / 0.73 / +5.2%
tpcds_q11/datafusion:parquet 97893285 / 97533964 / +0.4% 122750096 / 120969430 / +1.5% 0.80 / 0.81 / -1.1%
tpcds_q12/datafusion:parquet 23617374 / 23914738 / -1.2% 39246708 / 36680108 / +7.0% 0.60 / 0.65 / -7.7%
tpcds_q13/datafusion:parquet 46463472 / 46878954 / -0.9% 68966190 / 66939426 / +3.0% 0.67 / 0.70 / -3.8%
tpcds_q14/datafusion:parquet 534708208 / 534541474 / +0.0% 584873558 / 584728411 / +0.0% 0.91 / 0.91 / +0.0%
tpcds_q15/datafusion:parquet 23470182 / 23577942 / -0.5% 38163924 / 39488605 / -3.4% 0.61 / 0.60 / +3.0%
tpcds_q16/datafusion:parquet 37649304 / 36903159 / +2.0% 51185060 / 51357187 / -0.3% 0.74 / 0.72 / +2.4%
tpcds_q17/datafusion:parquet 74104574 / 74036442 / +0.1% 97890574 / 100416891 / -2.5% 0.76 / 0.74 / +2.7%
tpcds_q18/datafusion:parquet 65266344 / 69612158 / -6.2% 88811631 / 87467470 / +1.5% 0.73 / 0.80 / -7.7%
tpcds_q19/datafusion:parquet 29756402 / 29463130 / +1.0% 44078836 / 44334192 / -0.6% 0.68 / 0.66 / +1.6%
tpcds_q20/datafusion:parquet 25175452 / 25584690 / -1.6% 41556294 / 37237292 / +11.6% 🔴 0.61 / 0.69 / -11.8%
tpcds_q21/datafusion:parquet 20380374 / 20239904 / +0.7% 32588022 / 33691420 / -3.3% 0.63 / 0.60 / +4.1%
tpcds_q22/datafusion:parquet 77255943 / 77223259 / +0.0% 89196788 / 90215974 / -1.1% 0.87 / 0.86 / +1.2%
tpcds_q23/datafusion:parquet 93295004 / 92326116 / +1.0% 120085824 / 120881993 / -0.7% 0.78 / 0.76 / +1.7%
tpcds_q24/datafusion:parquet 91162082 / 91633142 / -0.5% 117233418 / 116634459 / +0.5% 0.78 / 0.79 / -1.0%
tpcds_q25/datafusion:parquet 81108078 / 79966418 / +1.4% 97129990 / 102446880 / -5.2% 0.84 / 0.78 / +7.0%
tpcds_q26/datafusion:parquet 43615052 / 43823226 / -0.5% 59902038 / 63760976 / -6.1% 0.73 / 0.69 / +5.9%
tpcds_q27/datafusion:parquet 76264887 / 78818764 / -3.2% 98191290 / 97108117 / +1.1% 0.78 / 0.81 / -4.3%
tpcds_q28/datafusion:parquet 28541916 / 28858564 / -1.1% 42715832 / 44921340 / -4.9% 0.67 / 0.64 / +4.0%
tpcds_q29/datafusion:parquet 75300001 / 75646716 / -0.5% 98013337 / 97403847 / +0.6% 0.77 / 0.78 / -1.1%
tpcds_q30/datafusion:parquet 46573550 / 44910027 / +3.7% 57870206 / 59710293 / -3.1% 0.80 / 0.75 / +7.0%
tpcds_q31/datafusion:parquet 80814408 / 81033046 / -0.3% 99863961 / 102695042 / -2.8% 0.81 / 0.79 / +2.6%
tpcds_q32/datafusion:parquet 26746222 / 26504702 / +0.9% 40965295 / 39972139 / +2.5% 0.65 / 0.66 / -1.5%
tpcds_q33/datafusion:parquet 37427247 / 37067896 / +1.0% 56280028 / 54784966 / +2.7% 0.67 / 0.68 / -1.7%
tpcds_q34/datafusion:parquet 24390264 / 24594164 / -0.8% 35981048 / 37183385 / -3.2% 0.68 / 0.66 / +2.5%
tpcds_q35/datafusion:parquet 50893335 / 50729562 / +0.3% 64184758 / 63250175 / +1.5% 0.79 / 0.80 / -1.1%
tpcds_q36/datafusion:parquet 53316635 / 52298430 / +1.9% 71109312 / 70773532 / +0.5% 0.75 / 0.74 / +1.5%
tpcds_q37/datafusion:parquet 21236016 / 21079598 / +0.7% 34357230 / 36206793 / -5.1% 0.62 / 0.58 / +6.2%
tpcds_q38/datafusion:parquet 44686046 / 44331459 / +0.8% 59573531 / 64574379 / -7.7% 0.75 / 0.69 / +9.3%
tpcds_q39/datafusion:parquet 68425640 / 68397568 / +0.0% 84922642 / 85755545 / -1.0% 0.81 / 0.80 / +1.0%
tpcds_q40/datafusion:parquet 30085494 / 31866910 / -5.6% 49816829 / 51835495 / -3.9% 0.60 / 0.61 / -1.8%
tpcds_q41/datafusion:parquet 19532850 / 19870357 / -1.7% 32224403 / 32714071 / -1.5% 0.61 / 0.61 / -0.2%
tpcds_q42/datafusion:parquet 18500918 / 18401636 / +0.5% 30110344 / 31928747 / -5.7% 0.61 / 0.58 / +6.6%
tpcds_q43/datafusion:parquet 19603380 / 19248913 / +1.8% 32008421 / 31305022 / +2.2% 0.61 / 0.61 / -0.4%
tpcds_q44/datafusion:parquet 36679851 / 34538780 / +6.2% 51877973 / 49358081 / +5.1% 0.71 / 0.70 / +1.0%
tpcds_q45/datafusion:parquet 27838084 / 27004402 / +3.1% 41475674 / 42566778 / -2.6% 0.67 / 0.63 / +5.8%
tpcds_q46/datafusion:parquet 29303903 / 29675908 / -1.3% 47330427 / 47322071 / +0.0% 0.62 / 0.63 / -1.3%
tpcds_q47/datafusion:parquet 98070226 / 96953894 / +1.2% 123099027 / 121264990 / +1.5% 0.80 / 0.80 / -0.4%
tpcds_q48/datafusion:parquet 42222064 / 41173272 / +2.5% 59521524 / 58453971 / +1.8% 0.71 / 0.70 / +0.7%
tpcds_q49/datafusion:parquet 71134683 / 72728802 / -2.2% 96312158 / 94693734 / +1.7% 0.74 / 0.77 / -3.8%
tpcds_q50/datafusion:parquet 48128842 / 47225491 / +1.9% 71267255 / 68018295 / +4.8% 0.68 / 0.69 / -2.7%
tpcds_q51/datafusion:parquet 75770868 / 76281862 / -0.7% 96024105 / 95062721 / +1.0% 0.79 / 0.80 / -1.7%
tpcds_q52/datafusion:parquet 18790802 / 18652128 / +0.7% 31399756 / 31081382 / +1.0% 0.60 / 0.60 / -0.3%
tpcds_q53/datafusion:parquet 22253520 / 22606421 / -1.6% 40031126 / 39644905 / +1.0% 0.56 / 0.57 / -2.5%
tpcds_q54/datafusion:parquet 51487346 / 52671524 / -2.2% 68396815 / 68401199 / -0.0% 0.75 / 0.77 / -2.2%
tpcds_q55/datafusion:parquet 18307598 / 18445008 / -0.7% 30297001 / 31401224 / -3.5% 0.60 / 0.59 / +2.9%
tpcds_q56/datafusion:parquet 40239094 / 39777869 / +1.2% 56170314 / 57401067 / -2.1% 0.72 / 0.69 / +3.4%
tpcds_q57/datafusion:parquet 102811896 / 101237647 / +1.6% 118181444 / 121779537 / -3.0% 0.87 / 0.83 / +4.6%
tpcds_q58/datafusion:parquet 65334408 / 65332867 / +0.0% 84595052 / 83366398 / +1.5% 0.77 / 0.78 / -1.5%
tpcds_q59/datafusion:parquet 48740506 / 47840877 / +1.9% 64238693 / 65991799 / -2.7% 0.76 / 0.72 / +4.7%
tpcds_q60/datafusion:parquet 40747254 / 41036971 / -0.7% 56607315 / 53019435 / +6.8% 0.72 / 0.77 / -7.0%
tpcds_q61/datafusion:parquet 37720886 / 36840030 / +2.4% 52106702 / 5197443 / +0.3% 0.72 / 0.71 / +2.1%
tpcds_q62/datafusion:parquet 25424417 / 25221012 / +0.8% 39875261 / 38052296 / +4.8% 0.64 / 0.66 / -3.8%
tpcds_q63/datafusion:parquet 22635954 / 22486306 / +0.7% 39478544 / 39006829 / +1.2% 0.57 / 0.58 / -0.5%
tpcds_q64/datafusion:parquet 289785353 / 289069004 / +0.2% 328245038 / 333885934 / -1.7% 0.88 / 0.87 / +2.0%
tpcds_q65/datafusion:parquet 121693362 / 121584842 / +0.1% 140937933 / 141528637 / -0.4% 0.86 / 0.86 / +0.5%
tpcds_q66/datafusion:parquet 60316672 / 59993962 / +0.5% 79591768 / 79179525 / +0.5% 0.76 / 0.76 / +0.0%
tpcds_q67/datafusion:parquet 68768900 / 68778406 / -0.0% 92251829 / 92859868 / -0.7% 0.75 / 0.74 / +0.6%
tpcds_q68/datafusion:parquet 29701490 / 29561135 / +0.5% 49735581 / 48238089 / +3.1% 0.60 / 0.61 / -2.6%
tpcds_q69/datafusion:parquet 43837215 / 43674277 / +0.4% 59090117 / 59352032 / -0.4% 0.74 / 0.74 / +0.8%
tpcds_q70/datafusion:parquet 81439150 / 80866330 / +0.7% 99896880 / 99910633 / -0.0% 0.82 / 0.81 / +0.7%
tpcds_q71/datafusion:parquet 26100796 / 26458457 / -1.4% 39464534 / 37469141 / +5.3% 0.66 / 0.71 / -6.3%
tpcds_q72/datafusion:parquet 523220714 / 521265732 / +0.4% 544835202 / 545271466 / -0.1% 0.96 / 0.96 / +0.5%
tpcds_q73/datafusion:parquet 24192768 / 24018747 / +0.7% 36413437 / 38011868 / -4.2% 0.66 / 0.63 / +5.1%
tpcds_q74/datafusion:parquet 70243518 / 69184580 / +1.5% 83306408 / 91263036 / -8.7% 0.84 / 0.76 / +11.2%
tpcds_q75/datafusion:parquet 151819763 / 154922588 / -2.0% 182786175 / 181846272 / +0.5% 0.83 / 0.85 / -2.5%
tpcds_q76/datafusion:parquet 33716136 / 33298672 / +1.3% 49692080 / 47417541 / +4.8% 0.68 / 0.70 / -3.4%
tpcds_q77/datafusion:parquet 55103703 / 56055510 / -1.7% 77148864 / 75114350 / +2.7% 0.71 / 0.75 / -4.3%
tpcds_q78/datafusion:parquet 87670576 / 85608694 / +2.4% 118056569 / 118323194 / -0.2% 0.74 / 0.72 / +2.6%
tpcds_q79/datafusion:parquet 27529872 / 27355963 / +0.6% 43124617 / 42891935 / +0.5% 0.64 / 0.64 / +0.1%
tpcds_q80/datafusion:parquet 80764540 / 80362052 / +0.5% 114097097 / 111702744 / +2.1% 0.71 / 0.72 / -1.6%
tpcds_q81/datafusion:parquet 38007792 / 38206269 / -0.5% 52824808 / 53697939 / -1.6% 0.72 / 0.71 / +1.1%
tpcds_q82/datafusion:parquet 22469107 / 22659766 / -0.8% 36484095 / 35904500 / +1.6% 0.62 / 0.63 / -2.4%
tpcds_q83/datafusion:parquet 58032118 / 58739594 / -1.2% 75195391 / 77968462 / -3.6% 0.77 / 0.75 / +2.4%
tpcds_q84/datafusion:parquet 27442204 / 26037476 / +5.4% 41985351 / 40635529 / +3.3% 0.65 / 0.64 / +2.0%
tpcds_q85/datafusion:parquet 80288666 / 81547744 / -1.5% 104034013 / 105417991 / -1.3% 0.77 / 0.77 / -0.2%
tpcds_q86/datafusion:parquet 20740704 / 20893532 / -0.7% 34208576 / 33609037 / +1.8% 0.61 / 0.62 / -2.5%
tpcds_q87/datafusion:parquet 45701542 / 45534446 / +0.4% 59935702 / 62718805 / -4.4% 0.76 / 0.73 / +5.0%
tpcds_q88/datafusion:parquet 37599614 / 37655070 / -0.1% 53565471 / 51986712 / +3.0% 0.70 / 0.72 / -3.1%
tpcds_q89/datafusion:parquet 25855352 / 26105558 / -1.0% 41980107 / 42436747 / -1.1% 0.62 / 0.62 / +0.1%
tpcds_q90/datafusion:parquet 15421746 / 14791277 / +4.3% 26842133 / 26029973 / +3.1% 0.57 / 0.57 / +1.1%
tpcds_q91/datafusion:parquet 32110169 / 32267758 / -0.5% 46360908 / 48142955 / -3.7% 0.69 / 0.67 / +3.3%
tpcds_q92/datafusion:parquet 26981647 / 26852836 / +0.5% 41857299 / 40339074 / +3.8% 0.64 / 0.67 / -3.2%
tpcds_q93/datafusion:parquet 28371047 / 27708546 / +2.4% 44010479 / 47696759 / -7.7% 0.64 / 0.58 / +11.0%
tpcds_q94/datafusion:parquet 35284308 / 35662440 / -1.1% 48362830 / 49485564 / -2.3% 0.73 / 0.72 / +1.2%
tpcds_q95/datafusion:parquet 65211428 / 64002937 / +1.9% 78816370 / 74636672 / +5.6% 0.83 / 0.86 / -3.5%
tpcds_q96/datafusion:parquet 12605576 / 12442775 / +1.3% 24542900 / 24295052 / +1.0% 0.51 / 0.51 / +0.3%
tpcds_q97/datafusion:parquet 35526198 / 35789416 / -0.7% 52414233 / 51288695 / +2.2% 0.68 / 0.70 / -2.9%
tpcds_q98/datafusion:parquet 25170734 / 24851170 / +1.3% 39304182 / 40262457 / -2.4% 0.64 / 0.62 / +3.8%
tpcds_q99/datafusion:parquet 29585438 / 29694588 / -0.4% 42030944 / 42267674 / -0.6% 0.70 / 0.70 / +0.2%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 15881936 / 15930985 / -0.3% 24803526 / 25261789 / -1.8% 0.64 / 0.63 / +1.5%
tpcds_q02/duckdb:vortex-file-compressed 15542801 / 15548446 / -0.0% 23801035 / 23529730 / +1.2% 0.65 / 0.66 / -1.2%
tpcds_q03/duckdb:vortex-file-compressed 7136245 / 7211768 / -1.0% 16764236 / 17227431 / -2.7% 0.43 / 0.42 / +1.7%
tpcds_q04/duckdb:vortex-file-compressed 45302426 / 45924002 / -1.4% 54461889 / 54732486 / -0.5% 0.83 / 0.84 / -0.9%
tpcds_q05/duckdb:vortex-file-compressed 23318462 / 23535654 / -0.9% 31566220 / 32501190 / -2.9% 0.74 / 0.72 / +2.0%
tpcds_q06/duckdb:vortex-file-compressed 23819002 / 23919433 / -0.4% 37931955 / 38012663 / -0.2% 0.63 / 0.63 / -0.2%
tpcds_q07/duckdb:vortex-file-compressed 13607125 / 13592916 / +0.1% 25174079 / 24394011 / +3.2% 0.54 / 0.56 / -3.0%
tpcds_q08/duckdb:vortex-file-compressed 17404014 / 17415590 / -0.1% 25176480 / 25416956 / -0.9% 0.69 / 0.69 / +0.9%
tpcds_q09/duckdb:vortex-file-compressed 18697292 / 19122234 / -2.2% 29131901 / 30993054 / -6.0% 0.64 / 0.62 / +4.0%
tpcds_q10/duckdb:vortex-file-compressed 26833623 / 27477247 / -2.3% 40739348 / 39971702 / +1.9% 0.66 / 0.69 / -4.2%
tpcds_q11/duckdb:vortex-file-compressed 36457192 / 36808345 / -1.0% 45496118 / 45650549 / -0.3% 0.80 / 0.81 / -0.6%
tpcds_q12/duckdb:vortex-file-compressed 10004502 / 10158463 / -1.5% 17706775 / 18079668 / -2.1% 0.57 / 0.56 / +0.6%
tpcds_q13/duckdb:vortex-file-compressed 21035814 / 21003678 / +0.2% 34270781 / 34548547 / -0.8% 0.61 / 0.61 / +1.0%
tpcds_q14/duckdb:vortex-file-compressed 54708578 / 55250616 / -1.0% 65331273 / 65861426 / -0.8% 0.84 / 0.84 / -0.2%
tpcds_q15/duckdb:vortex-file-compressed 11167415 / 11140570 / +0.2% 18227340 / 18623165 / -2.1% 0.61 / 0.60 / +2.4%
tpcds_q16/duckdb:vortex-file-compressed 24346486 / 24128264 / +0.9% 35207592 / 35152431 / +0.2% 0.69 / 0.69 / +0.7%
tpcds_q17/duckdb:vortex-file-compressed 25277792 / 25744012 / -1.8% 40207216 / 40232840 / -0.1% 0.63 / 0.64 / -1.7%
tpcds_q18/duckdb:vortex-file-compressed 31211338 / 31283264 / -0.2% 42031681 / 41235768 / +1.9% 0.74 / 0.76 / -2.1%
tpcds_q19/duckdb:vortex-file-compressed 79213335 / 78365540 / +1.1% 90379660 / 90318131 / +0.1% 0.88 / 0.87 / +1.0%
tpcds_q20/duckdb:vortex-file-compressed 10930266 / 10599156 / +3.1% 17951398 / 18682897 / -3.9% 0.61 / 0.57 / +7.3%
tpcds_q21/duckdb:vortex-file-compressed 10316406 / 10419218 / -1.0% 22603489 / 23452487 / -3.6% 0.46 / 0.44 / +2.7%
tpcds_q22/duckdb:vortex-file-compressed 18208666 / 18319738 / -0.6% 29788691 / 29293744 / +1.7% 0.61 / 0.63 / -2.3%
tpcds_q23/duckdb:vortex-file-compressed 37689405 / 37657424 / +0.1% 50170092 / 50321461 / -0.3% 0.75 / 0.75 / +0.4%
tpcds_q24/duckdb:vortex-file-compressed 27335226 / 27393810 / -0.2% 40223903 / 38963661 / +3.2% 0.68 / 0.70 / -3.3%
tpcds_q25/duckdb:vortex-file-compressed 23689026 / 23944494 / -1.1% 38066850 / 38859504 / -2.0% 0.62 / 0.62 / +1.0%
tpcds_q26/duckdb:vortex-file-compressed 13026445 / 12740997 / +2.2% 21056132 / 21099820 / -0.2% 0.62 / 0.60 / +2.5%
tpcds_q27/duckdb:vortex-file-compressed 16016094 / 16157914 / -0.9% 27664525 / 26558028 / +4.2% 0.58 / 0.61 / -4.8%
tpcds_q28/duckdb:vortex-file-compressed 15771946 / 15687142 / +0.5% 25666905 / 25822779 / -0.6% 0.61 / 0.61 / +1.2%
tpcds_q29/duckdb:vortex-file-compressed 24002389 / 23950585 / +0.2% 37950625 / 38781294 / -2.1% 0.63 / 0.62 / +2.4%
tpcds_q30/duckdb:vortex-file-compressed 16208172 / 15995732 / +1.3% 25581812 / 24740137 / +3.4% 0.63 / 0.65 / -2.0%
tpcds_q31/duckdb:vortex-file-compressed 17858429 / 18074954 / -1.2% 26616351 / 26346525 / +1.0% 0.67 / 0.69 / -2.2%
tpcds_q32/duckdb:vortex-file-compressed 11739364 / 11565769 / +1.5% 20713579 / 20932111 / -1.0% 0.57 / 0.55 / +2.6%
tpcds_q33/duckdb:vortex-file-compressed 18938810 / 18744430 / +1.0% 28597968 / 28681855 / -0.3% 0.66 / 0.65 / +1.3%
tpcds_q34/duckdb:vortex-file-compressed 12377950 / 12629850 / -2.0% 22227069 / 22366718 / -0.6% 0.56 / 0.56 / -1.4%
tpcds_q35/duckdb:vortex-file-compressed 28392838 / 28459298 / -0.2% 39461476 / 40027954 / -1.4% 0.72 / 0.71 / +1.2%
tpcds_q36/duckdb:vortex-file-compressed 14696689 / 14836876 / -0.9% 24824756 / 24520236 / +1.2% 0.59 / 0.61 / -2.2%
tpcds_q37/duckdb:vortex-file-compressed 9459178 / 9438894 / +0.2% 24104372 / 23625034 / +2.0% 0.39 / 0.40 / -1.8%
tpcds_q38/duckdb:vortex-file-compressed 24087881 / 24248871 / -0.7% 31700417 / 31229476 / +1.5% 0.76 / 0.78 / -2.1%
tpcds_q39/duckdb:vortex-file-compressed 19790877 / 19706194 / +0.4% 32741704 / 32401733 / +1.0% 0.60 / 0.61 / -0.6%
tpcds_q40/duckdb:vortex-file-compressed 14356382 / 14436771 / -0.6% 22973673 / 21574849 / +6.5% 0.62 / 0.67 / -6.6%
tpcds_q41/duckdb:vortex-file-compressed 19559396 / 16998220 / +15.1% 🔴 27099874 / 23768072 / +14.0% 🔴 0.72 / 0.72 / +0.9%
tpcds_q42/duckdb:vortex-file-compressed 6858491 / 7016878 / -2.3% 15735259 / 15703401 / +0.2% 0.44 / 0.45 / -2.5%
tpcds_q43/duckdb:vortex-file-compressed 9830462 / 9795320 / +0.4% 18636502 / 19216108 / -3.0% 0.53 / 0.51 / +3.5%
tpcds_q44/duckdb:vortex-file-compressed 12891000 / 13102128 / -1.6% 22770761 / 24208092 / -5.9% 0.57 / 0.54 / +4.6%
tpcds_q45/duckdb:vortex-file-compressed 23719868 / 23538854 / +0.8% 31824778 / 31388677 / +1.4% 0.75 / 0.75 / -0.6%
tpcds_q46/duckdb:vortex-file-compressed 19080943 / 19596820 / -2.6% 27365712 / 27244954 / +0.4% 0.70 / 0.72 / -3.1%
tpcds_q47/duckdb:vortex-file-compressed 33592398 / 34157422 / -1.7% 44110700 / 44787574 / -1.5% 0.76 / 0.76 / -0.1%
tpcds_q48/duckdb:vortex-file-compressed 23589276 / 23434660 / +0.7% 37949520 / 37453578 / +1.3% 0.62 / 0.63 / -0.7%
tpcds_q49/duckdb:vortex-file-compressed 19661722 / 19482185 / +0.9% 32193499 / 33838766 / -4.9% 0.61 / 0.58 / +6.1%
tpcds_q50/duckdb:vortex-file-compressed 17503510 / 17429475 / +0.4% 29609872 / 29993316 / -1.3% 0.59 / 0.58 / +1.7%
tpcds_q51/duckdb:vortex-file-compressed 48647870 / 48512753 / +0.3% 58404118 / 59472809 / -1.8% 0.83 / 0.82 / +2.1%
tpcds_q52/duckdb:vortex-file-compressed 7014716 / 7490308 / -6.3% 15973671 / 16250436 / -1.7% 0.44 / 0.46 / -4.7%
tpcds_q53/duckdb:vortex-file-compressed 11223766 / 11292776 / -0.6% 21798150 / 21325402 / +2.2% 0.51 / 0.53 / -2.8%
tpcds_q54/duckdb:vortex-file-compressed 20045446 / 20065109 / -0.1% 30393361 / 29975898 / +1.4% 0.66 / 0.67 / -1.5%
tpcds_q55/duckdb:vortex-file-compressed 6926890 / 6764814 / +2.4% 15749340 / 15924029 / -1.1% 0.44 / 0.42 / +3.5%
tpcds_q56/duckdb:vortex-file-compressed 18097282 / 18170458 / -0.4% 27576904 / 28006494 / -1.5% 0.66 / 0.65 / +1.1%
tpcds_q57/duckdb:vortex-file-compressed 25635260 / 25740158 / -0.4% 33460082 / 34447712 / -2.9% 0.77 / 0.75 / +2.5%
tpcds_q58/duckdb:vortex-file-compressed 20082784 / 20260646 / -0.9% 29524309 / 29559226 / -0.1% 0.68 / 0.69 / -0.8%
tpcds_q59/duckdb:vortex-file-compressed 19641828 / 19940898 / -1.5% 27938916 / 27406551 / +1.9% 0.70 / 0.73 / -3.4%
tpcds_q60/duckdb:vortex-file-compressed 18778290 / 18739896 / +0.2% 28472238 / 28991290 / -1.8% 0.66 / 0.65 / +2.0%
tpcds_q61/duckdb:vortex-file-compressed 25151458 / 24884266 / +1.1% 34009594 / 34471170 / -1.3% 0.74 / 0.72 / +2.4%
tpcds_q62/duckdb:vortex-file-compressed 11659208 / 11933075 / -2.3% 19005187 / 19503880 / -2.6% 0.61 / 0.61 / +0.3%
tpcds_q63/duckdb:vortex-file-compressed 11242248 / 10847474 / +3.6% 21095749 / 19871243 / +6.2% 0.53 / 0.55 / -2.4%
tpcds_q64/duckdb:vortex-file-compressed 49880423 / 49708306 / +0.3% 70079154 / 69654481 / +0.6% 0.71 / 0.71 / -0.3%
tpcds_q65/duckdb:vortex-file-compressed 13006306 / 12941660 / +0.5% 22110648 / 22454789 / -1.5% 0.59 / 0.58 / +2.1%
tpcds_q66/duckdb:vortex-file-compressed 29912558 / 30063289 / -0.5% 40096024 / 39390313 / +1.8% 0.75 / 0.76 / -2.3%
tpcds_q67/duckdb:vortex-file-compressed 58096852 / 58443280 / -0.6% 68321116 / 67648134 / +1.0% 0.85 / 0.86 / -1.6%
tpcds_q68/duckdb:vortex-file-compressed 19020114 / 18857688 / +0.9% 27378205 / 27565733 / -0.7% 0.69 / 0.68 / +1.6%
tpcds_q69/duckdb:vortex-file-compressed 21991290 / 22476586 / -2.2% 38001252 / 38256751 / -0.7% 0.58 / 0.59 / -1.5%
tpcds_q70/duckdb:vortex-file-compressed 15862071 / 15651763 / +1.3% 25587075 / 25710638 / -0.5% 0.62 / 0.61 / +1.8%
tpcds_q71/duckdb:vortex-file-compressed 12811466 / 12918132 / -0.8% 22685850 / 22359071 / +1.5% 0.56 / 0.58 / -2.3%
tpcds_q72/duckdb:vortex-file-compressed 54922531 / 55442952 / -0.9% 70103769 / 69800041 / +0.4% 0.78 / 0.79 / -1.4%
tpcds_q73/duckdb:vortex-file-compressed 11230621 / 11239906 / -0.1% 20791893 / 20832152 / -0.2% 0.54 / 0.54 / +0.1%
tpcds_q74/duckdb:vortex-file-compressed 25961933 / 26291264 / -1.3% 34145412 / 34845507 / -2.0% 0.76 / 0.75 / +0.8%
tpcds_q75/duckdb:vortex-file-compressed 28631866 / 28941447 / -1.1% 39515176 / 40516450 / -2.5% 0.72 / 0.71 / +1.4%
tpcds_q76/duckdb:vortex-file-compressed 12778362 / 13298483 / -3.9% 22544327 / 24153305 / -6.7% 0.57 / 0.55 / +2.9%
tpcds_q77/duckdb:vortex-file-compressed 21180683 / 21003594 / +0.8% 30606396 / 29958489 / +2.2% 0.69 / 0.70 / -1.3%
tpcds_q78/duckdb:vortex-file-compressed 43429380 / 44349926 / -2.1% 53882869 / 53854929 / +0.1% 0.81 / 0.82 / -2.1%
tpcds_q79/duckdb:vortex-file-compressed 13244432 / 13127686 / +0.9% 22120025 / 22250560 / -0.6% 0.60 / 0.59 / +1.5%
tpcds_q80/duckdb:vortex-file-compressed 37258188 / 37031580 / +0.6% 51139312 / 49457028 / +3.4% 0.73 / 0.75 / -2.7%
tpcds_q81/duckdb:vortex-file-compressed 21630978 / 21736351 / -0.5% 29506395 / 29401101 / +0.4% 0.73 / 0.74 / -0.8%
tpcds_q82/duckdb:vortex-file-compressed 9566918 / 9770106 / -2.1% 24319014 / 25129587 / -3.2% 0.39 / 0.39 / +1.2%
tpcds_q83/duckdb:vortex-file-compressed 17552910 / 17492965 / +0.3% 24637241 / 24963465 / -1.3% 0.71 / 0.70 / +1.7%
tpcds_q84/duckdb:vortex-file-compressed 15604758 / 15279502 / +2.1% 23130009 / 23623870 / -2.1% 0.67 / 0.65 / +4.3%
tpcds_q85/duckdb:vortex-file-compressed 24599478 / 24572946 / +0.1% 37602555 / 39005108 / -3.6% 0.65 / 0.63 / +3.8%
tpcds_q86/duckdb:vortex-file-compressed 9802906 / 9687076 / +1.2% 17105712 / 17045208 / +0.4% 0.57 / 0.57 / +0.8%
tpcds_q87/duckdb:vortex-file-compressed 25702582 / 25716878 / -0.1% 32483803 / 33436238 / -2.8% 0.79 / 0.77 / +2.9%
tpcds_q88/duckdb:vortex-file-compressed 31331630 / 31468862 / -0.4% 39148116 / 39480946 / -0.8% 0.80 / 0.80 / +0.4%
tpcds_q89/duckdb:vortex-file-compressed 12269084 / 11964391 / +2.5% 22087345 / 21868858 / +1.0% 0.56 / 0.55 / +1.5%
tpcds_q90/duckdb:vortex-file-compressed 8122809 / 8086338 / +0.5% 15926851 / 16064764 / -0.9% 0.51 / 0.50 / +1.3%
tpcds_q91/duckdb:vortex-file-compressed 14112889 / 14307828 / -1.4% 22572206 / 22951614 / -1.7% 0.63 / 0.62 / +0.3%
tpcds_q92/duckdb:vortex-file-compressed 12092278 / 11954078 / +1.2% 21035005 / 21548948 / -2.4% 0.57 / 0.55 / +3.6%
tpcds_q93/duckdb:vortex-file-compressed 10691232 / 10597926 / +0.9% 25446122 / 25939399 / -1.9% 0.42 / 0.41 / +2.8%
tpcds_q94/duckdb:vortex-file-compressed 22146762 / 21922306 / +1.0% 31293997 / 32135705 / -2.6% 0.71 / 0.68 / +3.7%
tpcds_q95/duckdb:vortex-file-compressed 62686417 / 62247371 / +0.7% 71498420 / 71608668 / -0.2% 0.88 / 0.87 / +0.9%
tpcds_q96/duckdb:vortex-file-compressed 6821995 / 6869448 / -0.7% 15466203 / 15863914 / -2.5% 0.44 / 0.43 / +1.9%
tpcds_q97/duckdb:vortex-file-compressed 23024835 / 23012084 / +0.1% 32300028 / 32390191 / -0.3% 0.71 / 0.71 / +0.3%
tpcds_q98/duckdb:vortex-file-compressed 11392440 / 11274870 / +1.0% 19899399 / 19811297 / +0.4% 0.57 / 0.57 / +0.6%
tpcds_q99/duckdb:vortex-file-compressed 14745072 / 14875796 / -0.9% 22738407 / 23379307 / -2.7% 0.65 / 0.64 / +1.9%
duckdb / vortex-compact / ns (0.999x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-compact 17511206 / 17579578 / -0.4% 25943004 / 26977878 / -3.8% 0.67 / 0.65 / +3.6%
tpcds_q02/duckdb:vortex-compact 16484526 / 16831656 / -2.1% 24175892 / 24541173 / -1.5% 0.68 / 0.69 / -0.6%
tpcds_q03/duckdb:vortex-compact 8211346 / 7967468 / +3.1% 16450924 / 16897637 / -2.6% 0.50 / 0.47 / +5.9%
tpcds_q04/duckdb:vortex-compact 46766885 / 46760732 / +0.0% 57872316 / 57788459 / +0.1% 0.81 / 0.81 / -0.1%
tpcds_q05/duckdb:vortex-compact 25065756 / 25263834 / -0.8% 33296697 / 32560039 / +2.3% 0.75 / 0.78 / -3.0%
tpcds_q06/duckdb:vortex-compact 25218002 / 25180582 / +0.1% 39431005 / 39587844 / -0.4% 0.64 / 0.64 / +0.5%
tpcds_q07/duckdb:vortex-compact 18482110 / 18714916 / -1.2% 27897973 / 27934213 / -0.1% 0.66 / 0.67 / -1.1%
tpcds_q08/duckdb:vortex-compact 22539706 / 22736212 / -0.9% 29628229 / 29314606 / +1.1% 0.76 / 0.78 / -1.9%
tpcds_q09/duckdb:vortex-compact 21797373 / 21454210 / +1.6% 30119793 / 32444634 / -7.2% 0.72 / 0.66 / +9.4%
tpcds_q10/duckdb:vortex-compact 30792268 / 30896210 / -0.3% 44035630 / 45218584 / -2.6% 0.70 / 0.68 / +2.3%
tpcds_q11/duckdb:vortex-compact 38102070 / 38413840 / -0.8% 47849502 / 46841385 / +2.2% 0.80 / 0.82 / -2.9%
tpcds_q12/duckdb:vortex-compact 13017282 / 12852951 / +1.3% 19760904 / 19937222 / -0.9% 0.66 / 0.64 / +2.2%
tpcds_q13/duckdb:vortex-compact 37946422 / 37555902 / +1.0% 49597907 / 49518752 / +0.2% 0.77 / 0.76 / +0.9%
tpcds_q14/duckdb:vortex-compact 58369613 / 57879760 / +0.8% 68450782 / 69286874 / -1.2% 0.85 / 0.84 / +2.1%
tpcds_q15/duckdb:vortex-compact 14550691 / 14365537 / +1.3% 21998093 / 22577798 / -2.6% 0.66 / 0.64 / +4.0%
tpcds_q16/duckdb:vortex-compact 26033320 / 26749260 / -2.7% 35896756 / 35954845 / -0.2% 0.73 / 0.74 / -2.5%
tpcds_q17/duckdb:vortex-compact 29183143 / 29105506 / +0.3% 43704257 / 43237529 / +1.1% 0.67 / 0.67 / -0.8%
tpcds_q18/duckdb:vortex-compact 36388614 / 35780637 / +1.7% 44959010 / 45424548 / -1.0% 0.81 / 0.79 / +2.8%
tpcds_q19/duckdb:vortex-compact 82968558 / 82171575 / +1.0% 92888664 / 94358368 / -1.6% 0.89 / 0.87 / +2.6%
tpcds_q20/duckdb:vortex-compact 13328216 / 13315120 / +0.1% 20669705 / 21107953 / -2.1% 0.64 / 0.63 / +2.2%
tpcds_q21/duckdb:vortex-compact 11951468 / 12054098 / -0.9% 22910845 / 23849586 / -3.9% 0.52 / 0.51 / +3.2%
tpcds_q22/duckdb:vortex-compact 19639573 / 19585267 / +0.3% 30602587 / 31157542 / -1.8% 0.64 / 0.63 / +2.1%
tpcds_q23/duckdb:vortex-compact 40075806 / 40383270 / -0.8% 51684512 / 51683088 / +0.0% 0.78 / 0.78 / -0.8%
tpcds_q24/duckdb:vortex-compact 29188296 / 28993025 / +0.7% 40279768 / 40009904 / +0.7% 0.72 / 0.72 / -0.0%
tpcds_q25/duckdb:vortex-compact 27407316 / 27650970 / -0.9% 41382348 / 42398655 / -2.4% 0.66 / 0.65 / +1.6%
tpcds_q26/duckdb:vortex-compact 17130932 / 17310186 / -1.0% 25239030 / 25897974 / -2.5% 0.68 / 0.67 / +1.5%
tpcds_q27/duckdb:vortex-compact 20707671 / 21315916 / -2.9% 31419756 / 29979622 / +4.8% 0.66 / 0.71 / -7.3%
tpcds_q28/duckdb:vortex-compact 21156710 / 20873642 / +1.4% 31050662 / 31110853 / -0.2% 0.68 / 0.67 / +1.6%
tpcds_q29/duckdb:vortex-compact 27660001 / 27772492 / -0.4% 42795406 / 42839123 / -0.1% 0.65 / 0.65 / -0.3%
tpcds_q30/duckdb:vortex-compact 18305933 / 18215480 / +0.5% 27253609 / 27959872 / -2.5% 0.67 / 0.65 / +3.1%
tpcds_q31/duckdb:vortex-compact 18689025 / 19348680 / -3.4% 27364626 / 27051289 / +1.2% 0.68 / 0.72 / -4.5%
tpcds_q32/duckdb:vortex-compact 12889398 / 13065594 / -1.3% 22630112 / 22423444 / +0.9% 0.57 / 0.58 / -2.2%
tpcds_q33/duckdb:vortex-compact 20008914 / 20539936 / -2.6% 30297055 / 29546409 / +2.5% 0.66 / 0.70 / -5.0%
tpcds_q34/duckdb:vortex-compact 14393608 / 14373972 / +0.1% 24539408 / 24255273 / +1.2% 0.59 / 0.59 / -1.0%
tpcds_q35/duckdb:vortex-compact 31520016 / 31730104 / -0.7% 43480909 / 43314576 / +0.4% 0.72 / 0.73 / -1.0%
tpcds_q36/duckdb:vortex-compact 15690828 / 15792872 / -0.6% 25817324 / 25568141 / +1.0% 0.61 / 0.62 / -1.6%
tpcds_q37/duckdb:vortex-compact 13708923 / 13489833 / +1.6% 26030556 / 27053164 / -3.8% 0.53 / 0.50 / +5.6%
tpcds_q38/duckdb:vortex-compact 24952026 / 25016014 / -0.3% 32874055 / 32065683 / +2.5% 0.76 / 0.78 / -2.7%
tpcds_q39/duckdb:vortex-compact 20870420 / 20774777 / +0.5% 33133067 / 33126615 / +0.0% 0.63 / 0.63 / +0.4%
tpcds_q40/duckdb:vortex-compact 15775738 / 15506241 / +1.7% 22290659 / 23476672 / -5.1% 0.71 / 0.66 / +7.2%
tpcds_q41/duckdb:vortex-compact 21316786 / 18707998 / +13.9% 🔴 29072339 / 26250497 / +10.7% 🔴 0.73 / 0.71 / +2.9%
tpcds_q42/duckdb:vortex-compact 8008100 / 8124344 / -1.4% 16752009 / 16731941 / +0.1% 0.48 / 0.49 / -1.5%
tpcds_q43/duckdb:vortex-compact 11084564 / 10832654 / +2.3% 19430333 / 19720926 / -1.5% 0.57 / 0.55 / +3.9%
tpcds_q44/duckdb:vortex-compact 15316010 / 15059129 / +1.7% 26679082 / 26323515 / +1.4% 0.57 / 0.57 / +0.4%
tpcds_q45/duckdb:vortex-compact 26008757 / 26296077 / -1.1% 34286620 / 35780670 / -4.2% 0.76 / 0.73 / +3.2%
tpcds_q46/duckdb:vortex-compact 19938375 / 20225056 / -1.4% 28796430 / 28469385 / +1.1% 0.69 / 0.71 / -2.5%
tpcds_q47/duckdb:vortex-compact 35624518 / 35603220 / +0.1% 44822198 / 44655705 / +0.4% 0.79 / 0.80 / -0.3%
tpcds_q48/duckdb:vortex-compact 39158437 / 39336129 / -0.5% 51535573 / 51684728 / -0.3% 0.76 / 0.76 / -0.2%
tpcds_q49/duckdb:vortex-compact 23015987 / 23068836 / -0.2% 37294286 / 36684110 / +1.7% 0.62 / 0.63 / -1.9%
tpcds_q50/duckdb:vortex-compact 19153374 / 19141134 / +0.1% 30161427 / 30505396 / -1.1% 0.64 / 0.63 / +1.2%
tpcds_q51/duckdb:vortex-compact 50428333 / 50088440 / +0.7% 60301234 / 60308719 / -0.0% 0.84 / 0.83 / +0.7%
tpcds_q52/duckdb:vortex-compact 8281800 / 8278228 / +0.0% 17095372 / 16696255 / +2.4% 0.48 / 0.50 / -2.3%
tpcds_q53/duckdb:vortex-compact 13254734 / 13195730 / +0.4% 23017496 / 23018721 / -0.0% 0.58 / 0.57 / +0.5%
tpcds_q54/duckdb:vortex-compact 21683178 / 21596455 / +0.4% 31816275 / 31907042 / -0.3% 0.68 / 0.68 / +0.7%
tpcds_q55/duckdb:vortex-compact 7709383 / 7781256 / -0.9% 16464484 / 16464539 / -0.0% 0.47 / 0.47 / -0.9%
tpcds_q56/duckdb:vortex-compact 18872865 / 19137470 / -1.4% 29698781 / 29391187 / +1.0% 0.64 / 0.65 / -2.4%
tpcds_q57/duckdb:vortex-compact 27211028 / 27086051 / +0.5% 34863435 / 35388862 / -1.5% 0.78 / 0.77 / +2.0%
tpcds_q58/duckdb:vortex-compact 20747590 / 20989562 / -1.2% 30602160 / 30857513 / -0.8% 0.68 / 0.68 / -0.3%
tpcds_q59/duckdb:vortex-compact 20866520 / 20846257 / +0.1% 27945559 / 27890736 / +0.2% 0.75 / 0.75 / -0.1%
tpcds_q60/duckdb:vortex-compact 20557721 / 20578218 / -0.1% 30428927 / 29574379 / +2.9% 0.68 / 0.70 / -2.9%
tpcds_q61/duckdb:vortex-compact 25833064 / 25995371 / -0.6% 34700129 / 36991301 / -6.2% 0.74 / 0.70 / +5.9%
tpcds_q62/duckdb:vortex-compact 13076856 / 13223760 / -1.1% 20673445 / 20275835 / +2.0% 0.63 / 0.65 / -3.0%
tpcds_q63/duckdb:vortex-compact 12869558 / 12753374 / +0.9% 22415588 / 21975096 / +2.0% 0.57 / 0.58 / -1.1%
tpcds_q64/duckdb:vortex-compact 57576005 / 57962418 / -0.7% 75547896 / 76277035 / -1.0% 0.76 / 0.76 / +0.3%
tpcds_q65/duckdb:vortex-compact 14055082 / 13919756 / +1.0% 22331303 / 22733950 / -1.8% 0.63 / 0.61 / +2.8%
tpcds_q66/duckdb:vortex-compact 32696866 / 32272154 / +1.3% 39916204 / 41472501 / -3.8% 0.82 / 0.78 / +5.3%
tpcds_q67/duckdb:vortex-compact 59599026 / 59598236 / +0.0% 68560409 / 69148727 / -0.9% 0.87 / 0.86 / +0.9%
tpcds_q68/duckdb:vortex-compact 19821212 / 19974086 / -0.8% 29942738 / 28438303 / +5.3% 0.66 / 0.70 / -5.8%
tpcds_q69/duckdb:vortex-compact 27284402 / 27126177 / +0.6% 41538505 / 42880059 / -3.1% 0.66 / 0.63 / +3.8%
tpcds_q70/duckdb:vortex-compact 17908430 / 18196076 / -1.6% 28949374 / 28500225 / +1.6% 0.62 / 0.64 / -3.1%
tpcds_q71/duckdb:vortex-compact 13741334 / 13788744 / -0.3% 24076258 / 24460784 / -1.6% 0.57 / 0.56 / +1.2%
tpcds_q72/duckdb:vortex-compact 60572194 / 59994992 / +1.0% 75887819 / 75466468 / +0.6% 0.80 / 0.79 / +0.4%
tpcds_q73/duckdb:vortex-compact 13553682 / 13288242 / +2.0% 23023504 / 22886718 / +0.6% 0.59 / 0.58 / +1.4%
tpcds_q74/duckdb:vortex-compact 26807272 / 26789844 / +0.1% 35468464 / 34899287 / +1.6% 0.76 / 0.77 / -1.5%
tpcds_q75/duckdb:vortex-compact 30127015 / 30327993 / -0.7% 40014915 / 41221722 / -2.9% 0.75 / 0.74 / +2.3%
tpcds_q76/duckdb:vortex-compact 14397866 / 14477388 / -0.5% 25802444 / 24460855 / +5.5% 0.56 / 0.59 / -5.7%
tpcds_q77/duckdb:vortex-compact 23200595 / 23078982 / +0.5% 31437941 / 31206957 / +0.7% 0.74 / 0.74 / -0.2%
tpcds_q78/duckdb:vortex-compact 44876174 / 45326369 / -1.0% 55610698 / 55653820 / -0.1% 0.81 / 0.81 / -0.9%
tpcds_q79/duckdb:vortex-compact 13789736 / 16127876 / -14.5% 🟢 23075136 / 23584144 / -2.2% 0.60 / 0.68 / -12.6%
tpcds_q80/duckdb:vortex-compact 39675012 / 40967299 / -3.2% 51412848 / 52502218 / -2.1% 0.77 / 0.78 / -1.1%
tpcds_q81/duckdb:vortex-compact 24325746 / 24606705 / -1.1% 31976629 / 31026541 / +3.1% 0.76 / 0.79 / -4.1%
tpcds_q82/duckdb:vortex-compact 14057922 / 13876606 / +1.3% 25943038 / 27462623 / -5.5% 0.54 / 0.51 / +7.2%
tpcds_q83/duckdb:vortex-compact 18357357 / 18605669 / -1.3% 25827541 / 25721291 / +0.4% 0.71 / 0.72 / -1.7%
tpcds_q84/duckdb:vortex-compact 17701122 / 17501115 / +1.1% 24101225 / 24748761 / -2.6% 0.73 / 0.71 / +3.9%
tpcds_q85/duckdb:vortex-compact 38896331 / 38595619 / +0.8% 53424682 / 53111356 / +0.6% 0.73 / 0.73 / +0.2%
tpcds_q86/duckdb:vortex-compact 10747360 / 10639746 / +1.0% 18311847 / 17626982 / +3.9% 0.59 / 0.60 / -2.8%
tpcds_q87/duckdb:vortex-compact 26208246 / 26626984 / -1.6% 34657618 / 34606063 / +0.1% 0.76 / 0.77 / -1.7%
tpcds_q88/duckdb:vortex-compact 33400592 / 33186718 / +0.6% 40369307 / 40076416 / +0.7% 0.83 / 0.83 / -0.1%
tpcds_q89/duckdb:vortex-compact 13834209 / 13677598 / +1.1% 24032967 / 22074034 / +8.9% 0.58 / 0.62 / -7.1%
tpcds_q90/duckdb:vortex-compact 8864756 / 8813030 / +0.6% 16058597 / 16273823 / -1.3% 0.55 / 0.54 / +1.9%
tpcds_q91/duckdb:vortex-compact 22861789 / 23178232 / -1.4% 32681944 / 32371885 / +1.0% 0.70 / 0.72 / -2.3%
tpcds_q92/duckdb:vortex-compact 13834679 / 13879294 / -0.3% 22629222 / 23542720 / -3.9% 0.61 / 0.59 / +3.7%
tpcds_q93/duckdb:vortex-compact 12902930 / 13070875 / -1.3% 27142557 / 27374654 / -0.8% 0.48 / 0.48 / -0.4%
tpcds_q94/duckdb:vortex-compact 23460895 / 23387510 / +0.3% 33783297 / 33046462 / +2.2% 0.69 / 0.71 / -1.9%
tpcds_q95/duckdb:vortex-compact 63815045 / 64239244 / -0.7% 72874846 / 73341121 / -0.6% 0.88 / 0.88 / -0.0%
tpcds_q96/duckdb:vortex-compact 8714006 / 8586335 / +1.5% 16777770 / 18113048 / -7.4% 0.52 / 0.47 / +9.6%
tpcds_q97/duckdb:vortex-compact 23595256 / 23925064 / -1.4% 33087644 / 34165574 / -3.2% 0.71 / 0.70 / +1.8%
tpcds_q98/duckdb:vortex-compact 14305056 / 14272962 / +0.2% 22279315 / 22461489 / -0.8% 0.64 / 0.64 / +1.0%
tpcds_q99/duckdb:vortex-compact 15605879 / 15381886 / +1.5% 23280732 / 22662922 / +2.7% 0.67 / 0.68 / -1.2%
duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24240325 / 24385394 / -0.6% 31544007 / 31559940 / -0.1% 0.77 / 0.77 / -0.5%
tpcds_q02/duckdb:parquet 18288414 / 18534746 / -1.3% 24412500 / 25357008 / -3.7% 0.75 / 0.73 / +2.5%
tpcds_q03/duckdb:parquet 9805073 / 9905124 / -1.0% 15847994 / 16281703 / -2.7% 0.62 / 0.61 / +1.7%
tpcds_q04/duckdb:parquet 118056676 / 118588618 / -0.4% 127129420 / 127477237 / -0.3% 0.93 / 0.93 / -0.2%
tpcds_q05/duckdb:parquet 28984092 / 29052100 / -0.2% 33294769 / 33276562 / +0.1% 0.87 / 0.87 / -0.3%
tpcds_q06/duckdb:parquet 26950964 / 26992952 / -0.2% 36256509 / 35941183 / +0.9% 0.74 / 0.75 / -1.0%
tpcds_q07/duckdb:parquet 30913822 / 33164392 / -6.8% 39439666 / 38607365 / +2.2% 0.78 / 0.86 / -8.8%
tpcds_q08/duckdb:parquet 20283247 / 20286188 / -0.0% 24813983 / 25602295 / -3.1% 0.82 / 0.79 / +3.2%
tpcds_q09/duckdb:parquet 27186030 / 27410141 / -0.8% 30896127 / 33271294 / -7.1% 0.88 / 0.82 / +6.8%
tpcds_q10/duckdb:parquet 33055585 / 33057294 / -0.0% 40861844 / 41899510 / -2.5% 0.81 / 0.79 / +2.5%
tpcds_q11/duckdb:parquet 68472700 / 69036632 / -0.8% 76250803 / 75873112 / +0.5% 0.90 / 0.91 / -1.3%
tpcds_q12/duckdb:parquet 14147968 / 14362000 / -1.5% 19397522 / 19165115 / +1.2% 0.73 / 0.75 / -2.7%
tpcds_q13/duckdb:parquet 34449888 / 31669938 / +8.8% 39392535 / 40268413 / -2.2% 0.87 / 0.79 / +11.2%
tpcds_q14/duckdb:parquet 64091054 / 66804442 / -4.1% 68754376 / 70932710 / -3.1% 0.93 / 0.94 / -1.0%
tpcds_q15/duckdb:parquet 16877925 / 17101432 / -1.3% 23309772 / 23210426 / +0.4% 0.72 / 0.74 / -1.7%
tpcds_q16/duckdb:parquet 30641046 / 30648522 / -0.0% 37044779 / 37427645 / -1.0% 0.83 / 0.82 / +1.0%
tpcds_q17/duckdb:parquet 35154264 / 35436816 / -0.8% 41155085 / 41220057 / -0.2% 0.85 / 0.86 / -0.6%
tpcds_q18/duckdb:parquet 48014727 / 48248204 / -0.5% 55722901 / 56281967 / -1.0% 0.86 / 0.86 / +0.5%
tpcds_q19/duckdb:parquet 19022586 / 19257862 / -1.2% 25968560 / 26228372 / -1.0% 0.73 / 0.73 / -0.2%
tpcds_q20/duckdb:parquet 15123452 / 15366494 / -1.6% 19810425 / 20035576 / -1.1% 0.76 / 0.77 / -0.5%
tpcds_q21/duckdb:parquet 10895790 / 11039994 / -1.3% 17436590 / 16527867 / +5.5% 0.62 / 0.67 / -6.4%
tpcds_q22/duckdb:parquet 21076732 / 20966655 / +0.5% 26838836 / 26845711 / -0.0% 0.79 / 0.78 / +0.6%
tpcds_q23/duckdb:parquet 44415816 / 44670232 / -0.6% 49580529 / 48599048 / +2.0% 0.90 / 0.92 / -2.5%
tpcds_q24/duckdb:parquet 31289076 / 30851922 / +1.4% 38809920 / 37861820 / +2.5% 0.81 / 0.81 / -1.1%
tpcds_q25/duckdb:parquet 30993926 / 30933769 / +0.2% 37634531 / 37969932 / -0.9% 0.82 / 0.81 / +1.1%
tpcds_q26/duckdb:parquet 29560829 / 29759963 / -0.7% 36231278 / 35394924 / +2.4% 0.82 / 0.84 / -3.0%
tpcds_q27/duckdb:parquet 33327270 / 34274586 / -2.8% 41934691 / 42752201 / -1.9% 0.79 / 0.80 / -0.9%
tpcds_q28/duckdb:parquet 26369524 / 25578102 / +3.1% 38677115 / 33063967 / +17.0% 🔴 0.68 / 0.77 / -11.9%
tpcds_q29/duckdb:parquet 32426980 / 33792964 / -4.0% 40207401 / 41003649 / -1.9% 0.81 / 0.82 / -2.1%
tpcds_q30/duckdb:parquet 35855322 / 36599912 / -2.0% 45189649 / 45558395 / -0.8% 0.79 / 0.80 / -1.2%
tpcds_q31/duckdb:parquet 35877808 / 36003907 / -0.4% 43962885 / 43021771 / +2.2% 0.82 / 0.84 / -2.5%
tpcds_q32/duckdb:parquet 14613248 / 14500424 / +0.8% 21150437 / 21511087 / -1.7% 0.69 / 0.67 / +2.5%
tpcds_q33/duckdb:parquet 23948550 / 23785283 / +0.7% 30715159 / 29577624 / +3.8% 0.78 / 0.80 / -3.0%
tpcds_q34/duckdb:parquet 17519858 / 17979422 / -2.6% 24528645 / 24387389 / +0.6% 0.71 / 0.74 / -3.1%
tpcds_q35/duckdb:parquet 35234276 / 36458225 / -3.4% 44295805 / 44148247 / +0.3% 0.80 / 0.83 / -3.7%
tpcds_q36/duckdb:parquet 41010881 / 40899906 / +0.3% 48493871 / 48077232 / +0.9% 0.85 / 0.85 / -0.6%
tpcds_q37/duckdb:parquet 13040740 / 13154262 / -0.9% 20072407 / 20089510 / -0.1% 0.65 / 0.65 / -0.8%
tpcds_q38/duckdb:parquet 30199800 / 30194814 / +0.0% 34969545 / 34533116 / +1.3% 0.86 / 0.87 / -1.2%
tpcds_q39/duckdb:parquet 23336747 / 23861008 / -2.2% 30704573 / 29689070 / +3.4% 0.76 / 0.80 / -5.4%
tpcds_q40/duckdb:parquet 16266905 / 16639760 / -2.2% 21890145 / 21648451 / +1.1% 0.74 / 0.77 / -3.3%
tpcds_q41/duckdb:parquet 12207188 / 12350734 / -1.2% 18762015 / 18415927 / +1.9% 0.65 / 0.67 / -3.0%
tpcds_q42/duckdb:parquet 9821774 / 9833452 / -0.1% 15363762 / 15888483 / -3.3% 0.64 / 0.62 / +3.3%
tpcds_q43/duckdb:parquet 12575980 / 12400074 / +1.4% 18240194 / 19022711 / -4.1% 0.69 / 0.65 / +5.8%
tpcds_q44/duckdb:parquet 20557416 / 21434066 / -4.1% 26404623 / 28177560 / -6.3% 0.78 / 0.76 / +2.3%
tpcds_q45/duckdb:parquet 21443418 / 21520310 / -0.4% 28274787 / 28240479 / +0.1% 0.76 / 0.76 / -0.5%
tpcds_q46/duckdb:parquet 36538956 / 37698186 / -3.1% 43829770 / 44229700 / -0.9% 0.83 / 0.85 / -2.2%
tpcds_q47/duckdb:parquet 34281148 / 34342517 / -0.2% 41408118 / 41456136 / -0.1% 0.83 / 0.83 / -0.1%
tpcds_q48/duckdb:parquet 29010886 / 29425984 / -1.4% 36817019 / 37352799 / -1.4% 0.79 / 0.79 / +0.0%
tpcds_q49/duckdb:parquet 32356678 / 31688206 / +2.1% 36564943 / 37394575 / -2.2% 0.88 / 0.85 / +4.4%
tpcds_q50/duckdb:parquet 21193056 / 20109230 / +5.4% 25657093 / 25929198 / -1.0% 0.83 / 0.78 / +6.5%
tpcds_q51/duckdb:parquet 52416596 / 52414021 / +0.0% 59794260 / 77110182 / -22.5% 🟢 0.88 / 0.68 / +29.0%
tpcds_q52/duckdb:parquet 9654230 / 9715033 / -0.6% 15387478 / 16762947 / -8.2% 0.63 / 0.58 / +8.3%
tpcds_q53/duckdb:parquet 14085900 / 14127710 / -0.3% 21072559 / 21302833 / -1.1% 0.67 / 0.66 / +0.8%
tpcds_q54/duckdb:parquet 25539299 / 25612259 / -0.3% 33169480 / 32240350 / +2.9% 0.77 / 0.79 / -3.1%
tpcds_q55/duckdb:parquet 9708822 / 9660808 / +0.5% 15556037 / 16548257 / -6.0% 0.62 / 0.58 / +6.9%
tpcds_q56/duckdb:parquet 24991838 / 26043725 / -4.0% 31106192 / 30988906 / +0.4% 0.80 / 0.84 / -4.4%
tpcds_q57/duckdb:parquet 30827613 / 31012809 / -0.6% 36075300 / 37081540 / -2.7% 0.85 / 0.84 / +2.2%
tpcds_q58/duckdb:parquet 23970242 / 24637065 / -2.7% 30263347 / 30658483 / -1.3% 0.79 / 0.80 / -1.4%
tpcds_q59/duckdb:parquet 23456748 / 23587970 / -0.6% 29548781 / 29576317 / -0.1% 0.79 / 0.80 / -0.5%
tpcds_q60/duckdb:parquet 27226531 / 27077196 / +0.6% 32547551 / 33133252 / -1.8% 0.84 / 0.82 / +2.4%
tpcds_q61/duckdb:parquet 26068260 / 25733198 / +1.3% 29377592 / 29253118 / +0.4% 0.89 / 0.88 / +0.9%
tpcds_q62/duckdb:parquet 13179445 / 13457639 / -2.1% 18287025 / 18815976 / -2.8% 0.72 / 0.72 / +0.8%
tpcds_q63/duckdb:parquet 13464000 / 13608970 / -1.1% 20138000 / 20593862 / -2.2% 0.67 / 0.66 / +1.2%
tpcds_q64/duckdb:parquet 71311794 / 71510292 / -0.3% 83501158 / 81916082 / +1.9% 0.85 / 0.87 / -2.2%
tpcds_q65/duckdb:parquet 20186148 / 20567164 / -1.9% 25825047 / 25557132 / +1.0% 0.78 / 0.80 / -2.9%
tpcds_q66/duckdb:parquet 35266996 / 35470730 / -0.6% 42417767 / 43021521 / -1.4% 0.83 / 0.82 / +0.8%
tpcds_q67/duckdb:parquet 61983186 / 60785934 / +2.0% 67059351 / 68347003 / -1.9% 0.92 / 0.89 / +3.9%
tpcds_q68/duckdb:parquet 28481743 / 28823150 / -1.2% 36729983 / 38749224 / -5.2% 0.78 / 0.74 / +4.2%
tpcds_q69/duckdb:parquet 26068489 / 26355841 / -1.1% 34533270 / 34735821 / -0.6% 0.75 / 0.76 / -0.5%
tpcds_q70/duckdb:parquet 19482412 / 20202742 / -3.6% 26816624 / 27010547 / -0.7% 0.73 / 0.75 / -2.9%
tpcds_q71/duckdb:parquet 17094726 / 17003180 / +0.5% 24001021 / 24142416 / -0.6% 0.71 / 0.70 / +1.1%
tpcds_q72/duckdb:parquet 55046130 / 55038922 / +0.0% 62359464 / 63052802 / -1.1% 0.88 / 0.87 / +1.1%
tpcds_q73/duckdb:parquet 14940822 / 14982346 / -0.3% 21844644 / 22239952 / -1.8% 0.68 / 0.67 / +1.5%
tpcds_q74/duckdb:parquet 84296586 / 84319354 / -0.0% 90602549 / 91159918 / -0.6% 0.93 / 0.92 / +0.6%
tpcds_q75/duckdb:parquet 44616311 / 44911688 / -0.7% 52080405 / 51214110 / +1.7% 0.86 / 0.88 / -2.3%
tpcds_q76/duckdb:parquet 18281346 / 19706363 / -7.2% 23636697 / 23912041 / -1.2% 0.77 / 0.82 / -6.2%
tpcds_q77/duckdb:parquet 24665000 / 27140572 / -9.1% 31941607 / 31426474 / +1.6% 0.77 / 0.86 / -10.6%
tpcds_q78/duckdb:parquet 78607726 / 79537616 / -1.2% 87025839 / 85801640 / +1.4% 0.90 / 0.93 / -2.6%
tpcds_q79/duckdb:parquet 23721146 / 23077029 / +2.8% 29398369 / 29379348 / +0.1% 0.81 / 0.79 / +2.7%
tpcds_q80/duckdb:parquet 38454982 / 38946780 / -1.3% 44754751 / 44729502 / +0.1% 0.86 / 0.87 / -1.3%
tpcds_q81/duckdb:parquet 36703437 / 36809287 / -0.3% 45295387 / 45280839 / +0.0% 0.81 / 0.81 / -0.3%
tpcds_q82/duckdb:parquet 13735779 / 13990904 / -1.8% 20588308 / 20957866 / -1.8% 0.67 / 0.67 / -0.1%
tpcds_q83/duckdb:parquet 20462933 / 20467988 / -0.0% 25446635 / 25432827 / +0.1% 0.80 / 0.80 / -0.1%
tpcds_q84/duckdb:parquet 23428447 / 23144244 / +1.2% 29443525 / 29460451 / -0.1% 0.80 / 0.79 / +1.3%
tpcds_q85/duckdb:parquet 33093612 / 33414664 / -1.0% 40173478 / 40561679 / -1.0% 0.82 / 0.82 / -0.0%
tpcds_q86/duckdb:parquet 12016628 / 12047496 / -0.3% 17328592 / 17175794 / +0.9% 0.69 / 0.70 / -1.1%
tpcds_q87/duckdb:parquet 31452401 / 31486143 / -0.1% 36447994 / 37326528 / -2.4% 0.86 / 0.84 / +2.3%
tpcds_q88/duckdb:parquet 39593210 / 39988471 / -1.0% 45167739 / 44213839 / +2.2% 0.88 / 0.90 / -3.1%
tpcds_q89/duckdb:parquet 15115929 / 14344416 / +5.4% 21523729 / 21471196 / +0.2% 0.70 / 0.67 / +5.1%
tpcds_q90/duckdb:parquet 10218489 / 10350980 / -1.3% 15230815 / 15677016 / -2.8% 0.67 / 0.66 / +1.6%
tpcds_q91/duckdb:parquet 21315856 / 21672431 / -1.6% 28756711 / 29190918 / -1.5% 0.74 / 0.74 / -0.2%
tpcds_q92/duckdb:parquet 15923678 / 15939325 / -0.1% 22008030 / 22521300 / -2.3% 0.72 / 0.71 / +2.2%
tpcds_q93/duckdb:parquet 14254342 / 14419804 / -1.1% 20556098 / 20930986 / -1.8% 0.69 / 0.69 / +0.7%
tpcds_q94/duckdb:parquet 25679496 / 25913110 / -0.9% 32925694 / 32515717 / +1.3% 0.78 / 0.80 / -2.1%
tpcds_q95/duckdb:parquet 44188963 / 43914962 / +0.6% 49913304 / 50213640 / -0.6% 0.89 / 0.87 / +1.2%
tpcds_q96/duckdb:parquet 8477594 / 8470518 / +0.1% 13787204 / 13932652 / -1.0% 0.61 / 0.61 / +1.1%
tpcds_q97/duckdb:parquet 27689816 / 27749156 / -0.2% 33510043 / 33092816 / +1.3% 0.83 / 0.84 / -1.5%
tpcds_q98/duckdb:parquet 16533325 / 16685258 / -0.9% 23815405 / 23270533 / +2.3% 0.69 / 0.72 / -3.2%
tpcds_q99/duckdb:parquet 19211284 / 19512269 / -1.5% 24656501 / 24496315 / +0.7% 0.78 / 0.80 / -2.2%
duckdb / duckdb / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:duckdb 15901241 / 15987950 / -0.5% 25476843 / 24779822 / +2.8% 0.62 / 0.65 / -3.3%
tpcds_q02/duckdb:duckdb 12566112 / 12825874 / -2.0% 19018567 / 19058294 / -0.2% 0.66 / 0.67 / -1.8%
tpcds_q03/duckdb:duckdb 5048772 / 5091098 / -0.8% 12756854 / 12052611 / +5.8% 0.40 / 0.42 / -6.3%
tpcds_q04/duckdb:duckdb 49600422 / 48440995 / +2.4% 56757063 / 56654005 / +0.2% 0.87 / 0.86 / +2.2%
tpcds_q05/duckdb:duckdb 15861552 / 16106630 / -1.5% 22134664 / 22323908 / -0.8% 0.72 / 0.72 / -0.7%
tpcds_q06/duckdb:duckdb 17926808 / 18212908 / -1.6% 29088538 / 29663928 / -1.9% 0.62 / 0.61 / +0.4%
tpcds_q07/duckdb:duckdb 21429960 / 21219628 / +1.0% 32096775 / 31842208 / +0.8% 0.67 / 0.67 / +0.2%
tpcds_q08/duckdb:duckdb 18516825 / 18766020 / -1.3% 28472440 / 28727478 / -0.9% 0.65 / 0.65 / -0.4%
tpcds_q09/duckdb:duckdb 8434647 / 8815194 / -4.3% 13981318 / 13587128 / +2.9% 0.60 / 0.65 / -7.0%
tpcds_q10/duckdb:duckdb 17862368 / 18085405 / -1.2% 29154406 / 28324198 / +2.9% 0.61 / 0.64 / -4.0%
tpcds_q11/duckdb:duckdb 42894222 / 42247006 / +1.5% 50937544 / 51653224 / -1.4% 0.84 / 0.82 / +3.0%
tpcds_q12/duckdb:duckdb 9243800 / 9304175 / -0.6% 16617412 / 17053491 / -2.6% 0.56 / 0.55 / +2.0%
tpcds_q13/duckdb:duckdb 20554848 / 20520332 / +0.2% 33550557 / 33234466 / +1.0% 0.61 / 0.62 / -0.8%
tpcds_q14/duckdb:duckdb 40506319 / 40541664 / -0.1% 48484860 / 47568695 / +1.9% 0.84 / 0.85 / -2.0%
tpcds_q15/duckdb:duckdb 8051739 / 8241628 / -2.3% 14320549 / 14526406 / -1.4% 0.56 / 0.57 / -0.9%
tpcds_q16/duckdb:duckdb 12476335 / 12638096 / -1.3% 21869998 / 22297588 / -1.9% 0.57 / 0.57 / +0.7%
tpcds_q17/duckdb:duckdb 17956485 / 17939220 / +0.1% 29612244 / 29757928 / -0.5% 0.61 / 0.60 / +0.6%
tpcds_q18/duckdb:duckdb 32650640 / 32789550 / -0.4% 46647037 / 46731278 / -0.2% 0.70 / 0.70 / -0.2%
tpcds_q19/duckdb:duckdb 10494840 / 10566843 / -0.7% 20349717 / 20446638 / -0.5% 0.52 / 0.52 / -0.2%
tpcds_q20/duckdb:duckdb 9936550 / 9998594 / -0.6% 16882555 / 17496910 / -3.5% 0.59 / 0.57 / +3.0%
tpcds_q21/duckdb:duckdb 6438632 / 6426456 / +0.2% 11584536 / 11647507 / -0.5% 0.56 / 0.55 / +0.7%
tpcds_q22/duckdb:duckdb 17602522 / 17741672 / -0.8% 23466910 / 23488445 / -0.1% 0.75 / 0.76 / -0.7%
tpcds_q23/duckdb:duckdb 27045875 / 27578433 / -1.9% 35946962 / 35986153 / -0.1% 0.75 / 0.77 / -1.8%
tpcds_q24/duckdb:duckdb 15263867 / 15590152 / -2.1% 31153493 / 31147351 / +0.0% 0.49 / 0.50 / -2.1%
tpcds_q25/duckdb:duckdb 14067672 / 14115948 / -0.3% 27384952 / 28169184 / -2.8% 0.51 / 0.50 / +2.5%
tpcds_q26/duckdb:duckdb 18517894 / 18174409 / +1.9% 27492064 / 27240200 / +0.9% 0.67 / 0.67 / +1.0%
tpcds_q27/duckdb:duckdb 24029536 / 23427600 / +2.6% 35996510 / 35920400 / +0.2% 0.67 / 0.65 / +2.4%
tpcds_q28/duckdb:duckdb 12294427 / 12080665 / +1.8% 18533243 / 18285424 / +1.4% 0.66 / 0.66 / +0.4%
tpcds_q29/duckdb:duckdb 14208360 / 14371269 / -1.1% 28092240 / 27602659 / +1.8% 0.51 / 0.52 / -2.9%
tpcds_q30/duckdb:duckdb 17811448 / 17746246 / +0.4% 31041961 / 29461936 / +5.4% 0.57 / 0.60 / -4.7%
tpcds_q31/duckdb:duckdb 30139860 / 30055416 / +0.3% 39295612 / 38652255 / +1.7% 0.77 / 0.78 / -1.4%
tpcds_q32/duckdb:duckdb 5429981 / 5618208 / -3.4% 13131892 / 12977192 / +1.2% 0.41 / 0.43 / -4.5%
tpcds_q33/duckdb:duckdb 9135436 / 9339715 / -2.2% 17059316 / 16528881 / +3.2% 0.54 / 0.57 / -5.2%
tpcds_q34/duckdb:duckdb 10533276 / 10629054 / -0.9% 20521961 / 20135084 / +1.9% 0.51 / 0.53 / -2.8%
tpcds_q35/duckdb:duckdb 24407366 / 24516722 / -0.4% 34703744 / 34164834 / +1.6% 0.70 / 0.72 / -2.0%
tpcds_q36/duckdb:duckdb 13304607 / 13392764 / -0.7% 24163528 / 23791557 / +1.6% 0.55 / 0.56 / -2.2%
tpcds_q37/duckdb:duckdb 5449621 / 5556024 / -1.9% 13685797 / 13658567 / +0.2% 0.40 / 0.41 / -2.1%
tpcds_q38/duckdb:duckdb 23780142 / 22874798 / +4.0% 30434359 / 30061116 / +1.2% 0.78 / 0.76 / +2.7%
tpcds_q39/duckdb:duckdb 19193564 / 19455509 / -1.3% 25371653 / 25443651 / -0.3% 0.76 / 0.76 / -1.1%
tpcds_q40/duckdb:duckdb 8716854 / 8691344 / +0.3% 16657445 / 17147206 / -2.9% 0.52 / 0.51 / +3.2%
tpcds_q41/duckdb:duckdb 10374718 / 10346492 / +0.3% 17510813 / 17369555 / +0.8% 0.59 / 0.60 / -0.5%
tpcds_q42/duckdb:duckdb 4926410 / 4893618 / +0.7% 12378543 / 12302869 / +0.6% 0.40 / 0.40 / +0.1%
tpcds_q43/duckdb:duckdb 8097676 / 8163932 / -0.8% 15344057 / 15455287 / -0.7% 0.53 / 0.53 / -0.1%
tpcds_q44/duckdb:duckdb 9391944 / 9370059 / +0.2% 18192681 / 18663388 / -2.5% 0.52 / 0.50 / +2.8%
tpcds_q45/duckdb:duckdb 13853056 / 14121805 / -1.9% 22906212 / 23671839 / -3.2% 0.60 / 0.60 / +1.4%
tpcds_q46/duckdb:duckdb 25370392 / 25283410 / +0.3% 36893374 / 36365306 / +1.5% 0.69 / 0.70 / -1.1%
tpcds_q47/duckdb:duckdb 33319639 / 33453868 / -0.4% 41951496 / 42613001 / -1.6% 0.79 / 0.79 / +1.2%
tpcds_q48/duckdb:duckdb 27301182 / 27454450 / -0.6% 37409963 / 38342167 / -2.4% 0.73 / 0.72 / +1.9%
tpcds_q49/duckdb:duckdb 14930324 / 14940172 / -0.1% 26046718 / 25475798 / +2.2% 0.57 / 0.59 / -2.3%
tpcds_q50/duckdb:duckdb 10693825 / 10758733 / -0.6% 19328098 / 19328884 / -0.0% 0.55 / 0.56 / -0.6%
tpcds_q51/duckdb:duckdb 46991012 / 46899624 / +0.2% 55016154 / 56046569 / -1.8% 0.85 / 0.84 / +2.1%
tpcds_q52/duckdb:duckdb 4932873 / 5001551 / -1.4% 12626798 / 12091828 / +4.4% 0.39 / 0.41 / -5.6%
tpcds_q53/duckdb:duckdb 9559656 / 9668162 / -1.1% 17872616 / 19376206 / -7.8% 0.53 / 0.50 / +7.2%
tpcds_q54/duckdb:duckdb 11844006 / 12319692 / -3.9% 22660284 / 21928372 / +3.3% 0.52 / 0.56 / -7.0%
tpcds_q55/duckdb:duckdb 4839246 / 4950940 / -2.3% 13570262 / 11702313 / +16.0% 🔴 0.36 / 0.42 / -15.7%
tpcds_q56/duckdb:duckdb 10388080 / 10449629 / -0.6% 18053730 / 18461531 / -2.2% 0.58 / 0.57 / +1.7%
tpcds_q57/duckdb:duckdb 28022911 / 27978319 / +0.2% 35222403 / 35470910 / -0.7% 0.80 / 0.79 / +0.9%
tpcds_q58/duckdb:duckdb 11198258 / 10973582 / +2.0% 18365231 / 18204650 / +0.9% 0.61 / 0.60 / +1.2%
tpcds_q59/duckdb:duckdb 17300250 / 17504505 / -1.2% 25868656 / 25340246 / +2.1% 0.67 / 0.69 / -3.2%
tpcds_q60/duckdb:duckdb 11115780 / 10817256 / +2.8% 18214745 / 18575895 / -1.9% 0.61 / 0.58 / +4.8%
tpcds_q61/duckdb:duckdb 10300898 / 10364128 / -0.6% 20041564 / 19500273 / +2.8% 0.51 / 0.53 / -3.3%
tpcds_q62/duckdb:duckdb 8737169 / 8763464 / -0.3% 15203735 / 15041635 / +1.1% 0.57 / 0.58 / -1.4%
tpcds_q63/duckdb:duckdb 9067287 / 9124185 / -0.6% 16995796 / 17204672 / -1.2% 0.53 / 0.53 / +0.6%
tpcds_q64/duckdb:duckdb 38716636 / 39087192 / -0.9% 58490789 / 59785135 / -2.2% 0.66 / 0.65 / +1.2%
tpcds_q65/duckdb:duckdb 9929000 / 9804932 / +1.3% 18293616 / 18110429 / +1.0% 0.54 / 0.54 / +0.3%
tpcds_q66/duckdb:duckdb 26780483 / 27002934 / -0.8% 37802122 / 37573768 / +0.6% 0.71 / 0.72 / -1.4%
tpcds_q67/duckdb:duckdb 55838449 / 54947654 / +1.6% 66053355 / 67029414 / -1.5% 0.85 / 0.82 / +3.1%
tpcds_q68/duckdb:duckdb 15877112 / 16005168 / -0.8% 27888963 / 28178862 / -1.0% 0.57 / 0.57 / +0.2%
tpcds_q69/duckdb:duckdb 15316527 / 15527130 / -1.4% 25100804 / 25115155 / -0.1% 0.61 / 0.62 / -1.3%
tpcds_q70/duckdb:duckdb 10247350 / 10050044 / +2.0% 19360662 / 19041279 / +1.7% 0.53 / 0.53 / +0.3%
tpcds_q71/duckdb:duckdb 8284692 / 8343105 / -0.7% 15817562 / 16673975 / -5.1% 0.52 / 0.50 / +4.7%
tpcds_q72/duckdb:duckdb 37710339 / 37949255 / -0.6% 49653088 / 49861989 / -0.4% 0.76 / 0.76 / -0.2%
tpcds_q73/duckdb:duckdb 8408295 / 8159020 / +3.1% 18117170 / 18239839 / -0.7% 0.46 / 0.45 / +3.8%
tpcds_q74/duckdb:duckdb 37084908 / 36016924 / +3.0% 45217068 / 43372783 / +4.3% 0.82 / 0.83 / -1.2%
tpcds_q75/duckdb:duckdb 30449346 / 30584922 / -0.4% 42536315 / 42748312 / -0.5% 0.72 / 0.72 / +0.1%
tpcds_q76/duckdb:duckdb 8529962 / 8510419 / +0.2% 17163148 / 17245068 / -0.5% 0.50 / 0.49 / +0.7%
tpcds_q77/duckdb:duckdb 11055515 / 11069390 / -0.1% 20046659 / 20531142 / -2.4% 0.55 / 0.54 / +2.3%
tpcds_q78/duckdb:duckdb 65835836 / 65594166 / +0.4% 76107404 / 77270595 / -1.5% 0.87 / 0.85 / +1.9%
tpcds_q79/duckdb:duckdb 12649830 / 12718494 / -0.5% 23980905 / 23756465 / +0.9% 0.53 / 0.54 / -1.5%
tpcds_q80/duckdb:duckdb 17525984 / 17440173 / +0.5% 29441248 / 30928061 / -4.8% 0.60 / 0.56 / +5.6%
tpcds_q81/duckdb:duckdb 25685916 / 25281715 / +1.6% 38247072 / 37297037 / +2.5% 0.67 / 0.68 / -0.9%
tpcds_q82/duckdb:duckdb 5901794 / 5961119 / -1.0% 14924313 / 14489854 / +3.0% 0.40 / 0.41 / -3.9%
tpcds_q83/duckdb:duckdb 9233128 / 9129675 / +1.1% 15690177 / 15591649 / +0.6% 0.59 / 0.59 / +0.5%
tpcds_q84/duckdb:duckdb 8969385 / 9135940 / -1.8% 18588277 / 18007608 / +3.2% 0.48 / 0.51 / -4.9%
tpcds_q85/duckdb:duckdb 21546350 / 21680476 / -0.6% 36505224 / 36030136 / +1.3% 0.59 / 0.60 / -1.9%
tpcds_q86/duckdb:duckdb 8668265 / 8662358 / +0.1% 15692746 / 15866892 / -1.1% 0.55 / 0.55 / +1.2%
tpcds_q87/duckdb:duckdb 26015674 / 24964352 / +4.2% 32580448 / 31285832 / +4.1% 0.80 / 0.80 / +0.1%
tpcds_q88/duckdb:duckdb 19611122 / 19590560 / +0.1% 26243484 / 26757148 / -1.9% 0.75 / 0.73 / +2.1%
tpcds_q89/duckdb:duckdb 10531030 / 10703992 / -1.6% 19152461 / 19859071 / -3.6% 0.55 / 0.54 / +2.0%
tpcds_q90/duckdb:duckdb 5074684 / 5074482 / +0.0% 11186367 / 11128385 / +0.5% 0.45 / 0.46 / -0.5%
tpcds_q91/duckdb:duckdb 9084000 / 8804262 / +3.2% 18558869 / 18737156 / -1.0% 0.49 / 0.47 / +4.2%
tpcds_q92/duckdb:duckdb 6912436 / 6809210 / +1.5% 14987746 / 14957896 / +0.2% 0.46 / 0.46 / +1.3%
tpcds_q93/duckdb:duckdb 7122762 / 7172064 / -0.7% 15238772 / 14926435 / +2.1% 0.47 / 0.48 / -2.7%
tpcds_q94/duckdb:duckdb 11918222 / 12055752 / -1.1% 23908284 / 23728941 / +0.8% 0.50 / 0.51 / -1.9%
tpcds_q95/duckdb:duckdb 35760735 / 35742728 / +0.1% 44939255 / 44002964 / +2.1% 0.80 / 0.81 / -2.0%
tpcds_q96/duckdb:duckdb 4052762 / 3830202 / +5.8% 10073701 / 9736067 / +3.5% 0.40 / 0.39 / +2.3%
tpcds_q97/duckdb:duckdb 21833456 / 21797798 / +0.2% 28234241 / 27851456 / +1.4% 0.77 / 0.78 / -1.2%
tpcds_q98/duckdb:duckdb 10978148 / 10878260 / +0.9% 19787547 / 20187087 / -2.0% 0.55 / 0.54 / +3.0%
tpcds_q99/duckdb:duckdb 13424418 / 13544261 / -0.9% 19454783 / 19587913 / -0.7% 0.69 / 0.69 / -0.2%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ab06f552 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+1.3%, low confidence) · DuckDB No clear signal (+2.9%, low confidence)
Vortex (geomean): hot 1.013x ➖ · cold 1.011x ➖
Parquet (geomean): hot 0.992x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-file-compressed 1824580 / 1801316 / +1.3% 7259462 / 7422778 / -2.2% 0.25 / 0.24 / +3.6%
statpopgen_q01/datafusion:vortex-file-compressed 3754712 / 3943280 / -4.8% 12749533 / 11997097 / +6.3% 0.29 / 0.33 / -10.4%
statpopgen_q02/datafusion:vortex-file-compressed 38718450 / 39114464 / -1.0% 66011296 / 65978120 / +0.1% 0.59 / 0.59 / -1.1%
statpopgen_q03/datafusion:vortex-file-compressed 116681094 / 118758096 / -1.7% 161798276 / 155948884 / +3.8% 0.72 / 0.76 / -5.3%
statpopgen_q04/datafusion:vortex-file-compressed 117910362 / 116169087 / +1.5% 157346316 / 159528909 / -1.4% 0.75 / 0.73 / +2.9%
statpopgen_q05/datafusion:vortex-file-compressed 69563862 / 69914816 / -0.5% 110131326 / 116427863 / -5.4% 0.63 / 0.60 / +5.2%
statpopgen_q06/datafusion:vortex-file-compressed 197816908 / 194141132 / +1.9% 232103406 / 235598350 / -1.5% 0.85 / 0.82 / +3.4%
statpopgen_q07/datafusion:vortex-file-compressed 283987036 / 282350234 / +0.6% 318508822 / 315723941 / +0.9% 0.89 / 0.89 / -0.3%
statpopgen_q08/datafusion:vortex-file-compressed 289483938 / 286272672 / +1.1% 327418130 / 321868639 / +1.7% 0.88 / 0.89 / -0.6%
statpopgen_q09/datafusion:vortex-file-compressed 96765318 / 97413792 / -0.7% 132147340 / 132763954 / -0.5% 0.73 / 0.73 / -0.2%
statpopgen_q10/datafusion:vortex-file-compressed 250097656 / 249147710 / +0.4% 299925040 / 293799449 / +2.1% 0.83 / 0.85 / -1.7%
datafusion / vortex-compact / ns (1.020x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:vortex-compact 1819188 / 1857066 / -2.0% 6960018 / 7532265 / -7.6% 0.26 / 0.25 / +6.0%
statpopgen_q01/datafusion:vortex-compact 4418400 / 4091602 / +8.0% 13446802 / 11895872 / +13.0% 🔴 0.33 / 0.34 / -4.5%
statpopgen_q02/datafusion:vortex-compact 44767392 / 43576800 / +2.7% 67447968 / 64565803 / +4.5% 0.66 / 0.67 / -1.7%
statpopgen_q03/datafusion:vortex-compact 121811516 / 123992080 / -1.8% 162658637 / 162230125 / +0.3% 0.75 / 0.76 / -2.0%
statpopgen_q04/datafusion:vortex-compact 121439377 / 117423552 / +3.4% 160932202 / 152413259 / +5.6% 0.75 / 0.77 / -2.1%
statpopgen_q05/datafusion:vortex-compact 79299722 / 73407715 / +8.0% 112390045 / 105205386 / +6.8% 0.71 / 0.70 / +1.1%
statpopgen_q06/datafusion:vortex-compact 198165104 / 194639111 / +1.8% 230891212 / 233132885 / -1.0% 0.86 / 0.83 / +2.8%
statpopgen_q07/datafusion:vortex-compact 355706596 / 353223138 / +0.7% 378568473 / 378644509 / -0.0% 0.94 / 0.93 / +0.7%
statpopgen_q08/datafusion:vortex-compact 364590836 / 364831908 / -0.1% 388459191 / 388527511 / -0.0% 0.94 / 0.94 / -0.0%
statpopgen_q09/datafusion:vortex-compact 99736478 / 98234108 / +1.5% 132969101 / 130800950 / +1.7% 0.75 / 0.75 / -0.1%
statpopgen_q10/datafusion:vortex-compact 252705378 / 252115734 / +0.2% 296781842 / 311664460 / -4.8% 0.85 / 0.81 / +5.3%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/datafusion:parquet 1975446 / 1969912 / +0.3% 91267503 / 92154232 / -1.0% 0.02 / 0.02 / +1.3%
statpopgen_q01/datafusion:parquet 165339808 / 165495054 / -0.1% 172983505 / 173595447 / -0.4% 0.96 / 0.95 / +0.3%
statpopgen_q02/datafusion:parquet 276142396 / 288094426 / -4.1% 426176521 / 417502004 / +2.1% 0.65 / 0.69 / -6.1%
statpopgen_q03/datafusion:parquet 387766108 / 396537763 / -2.2% 502469554 / 502224521 / +0.0% 0.77 / 0.79 / -2.3%
statpopgen_q04/datafusion:parquet 395194449 / 391203770 / +1.0% 539678219 / 520880083 / +3.6% 0.73 / 0.75 / -2.5%
statpopgen_q05/datafusion:parquet 321624176 / 312964034 / +2.8% 453093565 / 439019915 / +3.2% 0.71 / 0.71 / -0.4%
statpopgen_q06/datafusion:parquet 493020854 / 498177681 / -1.0% 631586244 / 599034975 / +5.4% 0.78 / 0.83 / -6.1%
statpopgen_q07/datafusion:parquet 423667802 / 426131124 / -0.6% 603228423 / 560761867 / +7.6% 0.70 / 0.76 / -7.6%
statpopgen_q08/datafusion:parquet 425082699 / 424142023 / +0.2% 551614583 / 546052009 / +1.0% 0.77 / 0.78 / -0.8%
statpopgen_q09/datafusion:parquet 351306754 / 355067116 / -1.1% 484626842 / 482116686 / +0.5% 0.72 / 0.74 / -1.6%
statpopgen_q10/datafusion:parquet 540401686 / 536327945 / +0.8% 684468585 / 670012451 / +2.2% 0.79 / 0.80 / -1.4%
duckdb / vortex-file-compressed / ns (1.024x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 12991922 / 12877822 / +0.9% 15430501 / 14908262 / +3.5% 0.84 / 0.86 / -2.5%
statpopgen_q01/duckdb:vortex-file-compressed 13871322 / 13659778 / +1.5% 17285595 / 16938804 / +2.0% 0.80 / 0.81 / -0.5%
statpopgen_q02/duckdb:vortex-file-compressed 145632428 / 119361850 / +22.0% 🔴 166671917 / 138232667 / +20.6% 🔴 0.87 / 0.86 / +1.2%
statpopgen_q03/duckdb:vortex-file-compressed 326566568 / 328418705 / -0.6% 346128587 / 339601123 / +1.9% 0.94 / 0.97 / -2.4%
statpopgen_q04/duckdb:vortex-file-compressed 318029718 / 322016944 / -1.2% 343504913 / 343580425 / -0.0% 0.93 / 0.94 / -1.2%
statpopgen_q05/duckdb:vortex-file-compressed 99154781 / 99661485 / -0.5% 121981072 / 123612260 / -1.3% 0.81 / 0.81 / +0.8%
statpopgen_q06/duckdb:vortex-file-compressed 226093466 / 226724362 / -0.3% 249215338 / 251048183 / -0.7% 0.91 / 0.90 / +0.5%
statpopgen_q07/duckdb:vortex-file-compressed 141012435 / 138102228 / +2.1% 171164841 / 178674088 / -4.2% 0.82 / 0.77 / +6.6%
statpopgen_q08/duckdb:vortex-file-compressed 151547493 / 146978799 / +3.1% 178491823 / 181652482 / -1.7% 0.85 / 0.81 / +4.9%
statpopgen_q09/duckdb:vortex-file-compressed 300973238 / 312548850 / -3.7% 324867956 / 325881914 / -0.3% 0.93 / 0.96 / -3.4%
statpopgen_q10/duckdb:vortex-file-compressed 826597980 / 787234928 / +5.0% 855049240 / 838499161 / +2.0% 0.97 / 0.94 / +3.0%
duckdb / vortex-compact / ns (1.009x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact 12808325 / 12697714 / +0.9% 14845497 / 15820795 / -6.2% 0.86 / 0.80 / +7.5%
statpopgen_q01/duckdb:vortex-compact 13816220 / 13839340 / -0.2% 17338370 / 17091851 / +1.4% 0.80 / 0.81 / -1.6%
statpopgen_q02/duckdb:vortex-compact 128072213 / 129355904 / -1.0% 158032124 / 151052924 / +4.6% 0.81 / 0.86 / -5.4%
statpopgen_q03/duckdb:vortex-compact 295920321 / 343789088 / -13.9% 🟢 365863674 / 364794208 / +0.3% 0.81 / 0.94 / -14.2%
statpopgen_q04/duckdb:vortex-compact 334325337 / 335393239 / -0.3% 355907205 / 357372133 / -0.4% 0.94 / 0.94 / +0.1%
statpopgen_q05/duckdb:vortex-compact 102842026 / 100223897 / +2.6% 128194494 / 122870708 / +4.3% 0.80 / 0.82 / -1.6%
statpopgen_q06/duckdb:vortex-compact 230169095 / 231610440 / -0.6% 252700866 / 252672550 / +0.0% 0.91 / 0.92 / -0.6%
statpopgen_q07/duckdb:vortex-compact 204161673 / 201703178 / +1.2% 231710613 / 224974624 / +3.0% 0.88 / 0.90 / -1.7%
statpopgen_q08/duckdb:vortex-compact 218466988 / 212587845 / +2.8% 241099281 / 242247510 / -0.5% 0.91 / 0.88 / +3.3%
statpopgen_q09/duckdb:vortex-compact 296850580 / 257773318 / +15.2% 🔴 317261951 / 306412900 / +3.5% 0.94 / 0.84 / +11.2%
statpopgen_q10/duckdb:vortex-compact 781678324 / 737531998 / +6.0% 811641530 / 805124556 / +0.8% 0.96 / 0.92 / +5.1%
duckdb / parquet / ns (0.988x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 273875500 / 274471646 / -0.2% 272966551 / 273170975 / -0.1% 1.00 / 1.00 / -0.1%
statpopgen_q01/duckdb:parquet 338021059 / 337237476 / +0.2% 341545699 / 342375387 / -0.2% 0.99 / 0.98 / +0.5%
statpopgen_q02/duckdb:parquet 584912426 / 596452956 / -1.9% 581505319 / 605690333 / -4.0% 1.01 / 0.98 / +2.1%
statpopgen_q03/duckdb:parquet 751685013 / 778539486 / -3.4% 829365674 / 840658753 / -1.3% 0.91 / 0.93 / -2.1%
statpopgen_q04/duckdb:parquet 774793454 / 755951242 / +2.5% 863187120 / 840521853 / +2.7% 0.90 / 0.90 / -0.2%
statpopgen_q05/duckdb:parquet 559243236 / 578775448 / -3.4% 606115240 / 613094567 / -1.1% 0.92 / 0.94 / -2.3%
statpopgen_q06/duckdb:parquet 690153575 / 648022071 / +6.5% 676918980 / 676919977 / -0.0% 1.02 / 0.96 / +6.5%
statpopgen_q07/duckdb:parquet 600046715 / 601071290 / -0.2% 646823967 / 683024542 / -5.3% 0.93 / 0.88 / +5.4%
statpopgen_q08/duckdb:parquet 607042712 / 619713665 / -2.0% 680787228 / 675271676 / +0.8% 0.89 / 0.92 / -2.8%
statpopgen_q09/duckdb:parquet 714727262 / 743346398 / -3.9% 789595336 / 789386398 / +0.0% 0.91 / 0.94 / -3.9%
statpopgen_q10/duckdb:parquet 994298349 / 1064568956 / -6.6% 1126192263 / 1161134237 / -3.0% 0.88 / 0.92 / -3.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ab06f552 vs base f3aef93b
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.6%
Engines: DataFusion No clear signal (+0.2%, environment too noisy confidence) · DuckDB No clear signal (+7.2%, environment too noisy confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.097x ➖
Parquet (geomean): hot 0.969x ➖ · cold 0.940x ➖
Shifts: Parquet (control) -3.1% · Median polish +1.9%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.041x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 220110782 / 234749682 / -6.2% 816095453 / 1029446513 / -20.7% 0.27 / 0.23 / +18.3%
tpch_q02/datafusion:vortex-file-compressed 343254009 / 302143285 / +13.6% 728665526 / 779753018 / -6.6% 0.47 / 0.39 / +21.6%
tpch_q03/datafusion:vortex-file-compressed 379553083 / 393376787 / -3.5% 1199144558 / 989574179 / +21.2% 0.32 / 0.40 / -20.4%
tpch_q04/datafusion:vortex-file-compressed 206117159 / 201849597 / +2.1% 425833036 / 451509973 / -5.7% 0.48 / 0.45 / +8.3%
tpch_q05/datafusion:vortex-file-compressed 423397575 / 428875778 / -1.3% 790773653 / 605491349 / +30.6% 🔴 0.54 / 0.71 / -24.4%
tpch_q06/datafusion:vortex-file-compressed 150022832 / 162325514 / -7.6% 344039977 / 475872942 / -27.7% 0.44 / 0.34 / +27.8%
tpch_q07/datafusion:vortex-file-compressed 387367426 / 610508353 / -36.6% 🟢 536990660 / 638052219 / -15.8% 0.72 / 0.96 / -24.6%
tpch_q08/datafusion:vortex-file-compressed 573610420 / 457365706 / +25.4% 823997430 / 647058908 / +27.3% 0.70 / 0.71 / -1.5%
tpch_q09/datafusion:vortex-file-compressed 463477999 / 425555262 / +8.9% 736265279 / 561345940 / +31.2% 🔴 0.63 / 0.76 / -17.0%
tpch_q10/datafusion:vortex-file-compressed 377919887 / 361774068 / +4.5% 527908231 / 584380009 / -9.7% 0.72 / 0.62 / +15.6%
tpch_q11/datafusion:vortex-file-compressed 291728049 / 283489311 / +2.9% 740626229 / 413295510 / +79.2% 🔴 0.39 / 0.69 / -42.6%
tpch_q12/datafusion:vortex-file-compressed 261930490 / 272108731 / -3.7% 406476453 / 398154951 / +2.1% 0.64 / 0.68 / -5.7%
tpch_q13/datafusion:vortex-file-compressed 134926016 / 153271401 / -12.0% 379386154 / 383042599 / -1.0% 0.36 / 0.40 / -11.1%
tpch_q14/datafusion:vortex-file-compressed 201588589 / 164061087 / +22.9% 318448073 / 314712343 / +1.2% 0.63 / 0.52 / +21.4%
tpch_q15/datafusion:vortex-file-compressed 326997787 / 305884225 / +6.9% 625065064 / 519818923 / +20.2% 0.52 / 0.59 / -11.1%
tpch_q16/datafusion:vortex-file-compressed 148783020 / 140251020 / +6.1% 303323196 / 340141130 / -10.8% 0.49 / 0.41 / +19.0%
tpch_q17/datafusion:vortex-file-compressed 298943259 / 338006051 / -11.6% 610161425 / 1108948416 / -45.0% 🟢 0.49 / 0.30 / +60.7%
tpch_q18/datafusion:vortex-file-compressed 446381567 / 268226521 / +66.4% 🔴 1042580171 / 452010641 / +130.7% 🔴 0.43 / 0.59 / -27.8%
tpch_q19/datafusion:vortex-file-compressed 263556736 / 369761612 / -28.7% 376280227 / 544706833 / -30.9% 🟢 0.70 / 0.68 / +3.2%
tpch_q20/datafusion:vortex-file-compressed 273011891 / 264019880 / +3.4% 498721509 / 444994335 / +12.1% 0.55 / 0.59 / -7.7%
tpch_q21/datafusion:vortex-file-compressed 501693954 / 554675643 / -9.6% 713894021 / 700511550 / +1.9% 0.70 / 0.79 / -11.2%
tpch_q22/datafusion:vortex-file-compressed 359603343 / 153087652 / +134.9% 🔴 643430988 / 352129727 / +82.7% 🔴 0.56 / 0.43 / +28.6%
datafusion / vortex-compact / ns (0.914x ➖, 3↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 218216298 / 235903320 / -7.5% 905175061 / 802895412 / +12.7% 0.24 / 0.29 / -17.9%
tpch_q02/datafusion:vortex-compact 301014211 / 311289836 / -3.3% 810700209 / 630644846 / +28.6% 0.37 / 0.49 / -24.8%
tpch_q03/datafusion:vortex-compact 326185322 / 309799331 / +5.3% 879820912 / 786875379 / +11.8% 0.37 / 0.39 / -5.8%
tpch_q04/datafusion:vortex-compact 168154182 / 177710758 / -5.4% 381090181 / 355274738 / +7.3% 0.44 / 0.50 / -11.8%
tpch_q05/datafusion:vortex-compact 442076143 / 356193988 / +24.1% 730831894 / 489514301 / +49.3% 🔴 0.60 / 0.73 / -16.9%
tpch_q06/datafusion:vortex-compact 152661516 / 136314306 / +12.0% 360284844 / 283634384 / +27.0% 0.42 / 0.48 / -11.8%
tpch_q07/datafusion:vortex-compact 422435705 / 399315747 / +5.8% 564765486 / 590536338 / -4.4% 0.75 / 0.68 / +10.6%
tpch_q08/datafusion:vortex-compact 422846315 / 496984501 / -14.9% 674992478 / 538649247 / +25.3% 0.63 / 0.92 / -32.1%
tpch_q09/datafusion:vortex-compact 251150654 / 487042248 / -48.4% 🟢 410766462 / 949631858 / -56.7% 🟢 0.61 / 0.51 / +19.2%
tpch_q10/datafusion:vortex-compact 304843010 / 350135445 / -12.9% 478131222 / 506567261 / -5.6% 0.64 / 0.69 / -7.8%
tpch_q11/datafusion:vortex-compact 263641159 / 313291291 / -15.8% 453921308 / 409381882 / +10.9% 0.58 / 0.77 / -24.1%
tpch_q12/datafusion:vortex-compact 198941080 / 183835249 / +8.2% 384973232 / 341828220 / +12.6% 0.52 / 0.54 / -3.9%
tpch_q13/datafusion:vortex-compact 112274215 / 110519604 / +1.6% 334423155 / 301617725 / +10.9% 0.34 / 0.37 / -8.4%
tpch_q14/datafusion:vortex-compact 196592667 / 176756387 / +11.2% 441108991 / 333836031 / +32.1% 🔴 0.45 / 0.53 / -15.8%
tpch_q15/datafusion:vortex-compact 344601922 / 313392794 / +10.0% 626838135 / 582908697 / +7.5% 0.55 / 0.54 / +2.3%
tpch_q16/datafusion:vortex-compact 148038329 / 149382432 / -0.9% 292594249 / 304367929 / -3.9% 0.51 / 0.49 / +3.1%
tpch_q17/datafusion:vortex-compact 226187208 / 510536192 / -55.7% 🟢 581188500 / 433177494 / +34.2% 🔴 0.39 / 1.18 / -67.0%
tpch_q18/datafusion:vortex-compact 262112618 / 223689240 / +17.2% 452375977 / 470538762 / -3.9% 0.58 / 0.48 / +21.9%
tpch_q19/datafusion:vortex-compact 240930893 / 254499621 / -5.3% 426717491 / 435448297 / -2.0% 0.56 / 0.58 / -3.4%
tpch_q20/datafusion:vortex-compact 264318048 / 268234762 / -1.5% 420988952 / 521996653 / -19.4% 0.63 / 0.51 / +22.2%
tpch_q21/datafusion:vortex-compact 455376775 / 956916431 / -52.4% 🟢 990699402 / 1443718010 / -31.4% 🟢 0.46 / 0.66 / -30.7%
tpch_q22/datafusion:vortex-compact 181894733 / 171814233 / +5.9% 309866826 / 409226827 / -24.3% 0.59 / 0.42 / +39.8%
datafusion / parquet / ns (0.973x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 156514466 / 172726277 / -9.4% 599515166 / 441624417 / +35.8% 🔴 0.26 / 0.39 / -33.3%
tpch_q02/datafusion:parquet 326124253 / 316060886 / +3.2% 737783689 / 598645594 / +23.2% 0.44 / 0.53 / -16.3%
tpch_q03/datafusion:parquet 256011876 / 231461108 / +10.6% 684030684 / 701983919 / -2.6% 0.37 / 0.33 / +13.5%
tpch_q04/datafusion:parquet 184486607 / 169043151 / +9.1% 410344383 / 311028881 / +31.9% 🔴 0.45 / 0.54 / -17.3%
tpch_q05/datafusion:parquet 340877552 / 369038095 / -7.6% 501642214 / 764004014 / -34.3% 🟢 0.68 / 0.48 / +40.7%
tpch_q06/datafusion:parquet 111070570 / 139918097 / -20.6% 264466484 / 269053237 / -1.7% 0.42 / 0.52 / -19.2%
tpch_q07/datafusion:parquet 336558664 / 338610357 / -0.6% 473150041 / 532284925 / -11.1% 0.71 / 0.64 / +11.8%
tpch_q08/datafusion:parquet 425455773 / 481081609 / -11.6% 543368161 / 691843025 / -21.5% 0.78 / 0.70 / +12.6%
tpch_q09/datafusion:parquet 419518276 / 408147480 / +2.8% 576852694 / 584671379 / -1.3% 0.73 / 0.70 / +4.2%
tpch_q10/datafusion:parquet 323205734 / 670389930 / -51.8% 🟢 468456681 / 1297868693 / -63.9% 🟢 0.69 / 0.52 / +33.6%
tpch_q11/datafusion:parquet 469858411 / 282288165 / +66.4% 🔴 725456144 / 494593065 / +46.7% 🔴 0.65 / 0.57 / +13.5%
tpch_q12/datafusion:parquet 158355761 / 184208408 / -14.0% 310611963 / 340925654 / -8.9% 0.51 / 0.54 / -5.6%
tpch_q13/datafusion:parquet 292875470 / 288281668 / +1.6% 483348031 / 473075004 / +2.2% 0.61 / 0.61 / -0.6%
tpch_q14/datafusion:parquet 169642051 / 152423732 / +11.3% 306329160 / 316565832 / -3.2% 0.55 / 0.48 / +15.0%
tpch_q15/datafusion:parquet 328741351 / 325892539 / +0.9% 513525285 / 654476826 / -21.5% 0.64 / 0.50 / +28.6%
tpch_q16/datafusion:parquet 113047784 / 111128606 / +1.7% 198092150 / 422003454 / -53.1% 🟢 0.57 / 0.26 / +116.7%
tpch_q17/datafusion:parquet 332465191 / 298975816 / +11.2% 454485418 / 449221457 / +1.2% 0.73 / 0.67 / +9.9%
tpch_q18/datafusion:parquet 315198796 / 318132521 / -0.9% 460415063 / 478740812 / -3.8% 0.68 / 0.66 / +3.0%
tpch_q19/datafusion:parquet 160312910 / 165238319 / -3.0% 273778224 / 333157522 / -17.8% 0.59 / 0.50 / +18.1%
tpch_q20/datafusion:parquet 243894987 / 252555353 / -3.4% 425129784 / 390644396 / +8.8% 0.57 / 0.65 / -11.3%
tpch_q21/datafusion:parquet 308927433 / 365984478 / -15.6% 492443188 / 579421217 / -15.0% 0.63 / 0.63 / -0.7%
tpch_q22/datafusion:parquet 162580122 / 153849197 / +5.7% 319358304 / 340268064 / -6.1% 0.51 / 0.45 / +12.6%
duckdb / vortex-file-compressed / ns (0.987x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 245030480 / 238438266 / +2.8% 255070496 / 243955732 / +4.6% 0.96 / 0.98 / -1.7%
tpch_q02/duckdb:vortex-file-compressed 421921231 / 470100548 / -10.2% 470029427 / 480351357 / -2.1% 0.90 / 0.98 / -8.3%
tpch_q03/duckdb:vortex-file-compressed 387684424 / 398821081 / -2.8% 435579833 / 443720220 / -1.8% 0.89 / 0.90 / -1.0%
tpch_q04/duckdb:vortex-file-compressed 261942266 / 236352570 / +10.8% 801049658 / 280485756 / +185.6% 🔴 0.33 / 0.84 / -61.2%
tpch_q05/duckdb:vortex-file-compressed 548482229 / 544053855 / +0.8% 748469109 / 636533968 / +17.6% 0.73 / 0.85 / -14.3%
tpch_q06/duckdb:vortex-file-compressed 286841367 / 302828529 / -5.3% 373365286 / 191373671 / +95.1% 🔴 0.77 / 1.58 / -51.4%
tpch_q07/duckdb:vortex-file-compressed 430383326 / 436577876 / -1.4% 447423880 / 517956221 / -13.6% 0.96 / 0.84 / +14.1%
tpch_q08/duckdb:vortex-file-compressed 904453814 / 659397438 / +37.2% 🔴 842582329 / 596132612 / +41.3% 🔴 1.07 / 1.11 / -3.0%
tpch_q09/duckdb:vortex-file-compressed 416592136 / 411441863 / +1.3% 467847617 / 439366093 / +6.5% 0.89 / 0.94 / -4.9%
tpch_q10/duckdb:vortex-file-compressed 548577530 / 541862704 / +1.2% 568761486 / 547944892 / +3.8% 0.96 / 0.99 / -2.5%
tpch_q11/duckdb:vortex-file-compressed 323401143 / 295143630 / +9.6% 410409628 / 307762288 / +33.4% 🔴 0.79 / 0.96 / -17.8%
tpch_q12/duckdb:vortex-file-compressed 229022405 / 311934244 / -26.6% 297148866 / 333515144 / -10.9% 0.77 / 0.94 / -17.6%
tpch_q13/duckdb:vortex-file-compressed 275383318 / 261464395 / +5.3% 262487323 / 220871823 / +18.8% 1.05 / 1.18 / -11.4%
tpch_q14/duckdb:vortex-file-compressed 241812949 / 229503550 / +5.4% 330681337 / 327467631 / +1.0% 0.73 / 0.70 / +4.3%
tpch_q15/duckdb:vortex-file-compressed 257591173 / 242745876 / +6.1% 290100532 / 298813389 / -2.9% 0.89 / 0.81 / +9.3%
tpch_q16/duckdb:vortex-file-compressed 223198699 / 198505504 / +12.4% 259878223 / 199127325 / +30.5% 🔴 0.86 / 1.00 / -13.8%
tpch_q17/duckdb:vortex-file-compressed 355682666 / 338810820 / +5.0% 410089324 / 395625550 / +3.7% 0.87 / 0.86 / +1.3%
tpch_q18/duckdb:vortex-file-compressed 317063850 / 432437101 / -26.7% 2049372058 / 439199995 / +366.6% 🔴 0.15 / 0.98 / -84.3%
tpch_q19/duckdb:vortex-file-compressed 268155333 / 268604753 / -0.2% 358297066 / 323357921 / +10.8% 0.75 / 0.83 / -9.9%
tpch_q20/duckdb:vortex-file-compressed 369161594 / 638411429 / -42.2% 🟢 490403365 / 654401568 / -25.1% 0.75 / 0.98 / -22.8%
tpch_q21/duckdb:vortex-file-compressed 658762197 / 611393711 / +7.7% 657089707 / 732695699 / -10.3% 1.00 / 0.83 / +20.1%
tpch_q22/duckdb:vortex-file-compressed 235377496 / 211342348 / +11.4% 312389284 / 228028097 / +37.0% 🔴 0.75 / 0.93 / -18.7%
duckdb / vortex-compact / ns (1.083x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 276504865 / 175206245 / +57.8% 🔴 288261103 / 252183138 / +14.3% 0.96 / 0.69 / +38.1%
tpch_q02/duckdb:vortex-compact 414339605 / 394993036 / +4.9% 481553081 / 503838663 / -4.4% 0.86 / 0.78 / +9.8%
tpch_q03/duckdb:vortex-compact 380989544 / 371435867 / +2.6% 437037425 / 409465475 / +6.7% 0.87 / 0.91 / -3.9%
tpch_q04/duckdb:vortex-compact 226585930 / 211241059 / +7.3% 270466493 / 241183236 / +12.1% 0.84 / 0.88 / -4.3%
tpch_q05/duckdb:vortex-compact 513982509 / 534963487 / -3.9% 684999305 / 555181049 / +23.4% 0.75 / 0.96 / -22.1%
tpch_q06/duckdb:vortex-compact 203181502 / 160117265 / +26.9% 220395800 / 195124223 / +13.0% 0.92 / 0.82 / +12.3%
tpch_q07/duckdb:vortex-compact 444651120 / 436400765 / +1.9% 574546154 / 456575927 / +25.8% 0.77 / 0.96 / -19.0%
tpch_q08/duckdb:vortex-compact 791062640 / 532211778 / +48.6% 🔴 831334456 / 691709535 / +20.2% 0.95 / 0.77 / +23.7%
tpch_q09/duckdb:vortex-compact 427478220 / 422555628 / +1.2% 455019510 / 573146140 / -20.6% 0.94 / 0.74 / +27.4%
tpch_q10/duckdb:vortex-compact 615268912 / 487011893 / +26.3% 639338353 / 666253131 / -4.0% 0.96 / 0.73 / +31.7%
tpch_q11/duckdb:vortex-compact 282945010 / 295908232 / -4.4% 337532301 / 314299917 / +7.4% 0.84 / 0.94 / -11.0%
tpch_q12/duckdb:vortex-compact 227862953 / 212955177 / +7.0% 265268853 / 289043839 / -8.2% 0.86 / 0.74 / +16.6%
tpch_q13/duckdb:vortex-compact 262649210 / 264891031 / -0.8% 242915047 / 213161489 / +14.0% 1.08 / 1.24 / -13.0%
tpch_q14/duckdb:vortex-compact 267412573 / 211129570 / +26.7% 339675837 / 283369036 / +19.9% 0.79 / 0.75 / +5.7%
tpch_q15/duckdb:vortex-compact 260314026 / 244224368 / +6.6% 398383901 / 287340118 / +38.6% 🔴 0.65 / 0.85 / -23.1%
tpch_q16/duckdb:vortex-compact 214027305 / 241489402 / -11.4% 247028885 / 234360694 / +5.4% 0.87 / 1.03 / -15.9%
tpch_q17/duckdb:vortex-compact 329796818 / 314034058 / +5.0% 437702585 / 334984450 / +30.7% 🔴 0.75 / 0.94 / -19.6%
tpch_q18/duckdb:vortex-compact 332787491 / 308980936 / +7.7% 498687847 / 464789890 / +7.3% 0.67 / 0.66 / +0.4%
tpch_q19/duckdb:vortex-compact 301080546 / 275999991 / +9.1% 324702909 / 329607065 / -1.5% 0.93 / 0.84 / +10.7%
tpch_q20/duckdb:vortex-compact 366434583 / 386982199 / -5.3% 475338091 / 446327627 / +6.5% 0.77 / 0.87 / -11.1%
tpch_q21/duckdb:vortex-compact 611446316 / 616728756 / -0.9% 843120739 / 709621047 / +18.8% 0.73 / 0.87 / -16.6%
tpch_q22/duckdb:vortex-compact 236619359 / 247957257 / -4.6% 282091219 / 277708694 / +1.6% 0.84 / 0.89 / -6.1%
duckdb / parquet / ns (0.964x ➖, 2↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 155676691 / 237926838 / -34.6% 🟢 214802357 / 300092733 / -28.4% 0.72 / 0.79 / -8.6%
tpch_q02/duckdb:parquet 460016122 / 451143228 / +2.0% 499149732 / 589276282 / -15.3% 0.92 / 0.77 / +20.4%
tpch_q03/duckdb:parquet 497054761 / 470677084 / +5.6% 493575844 / 703198193 / -29.8% 1.01 / 0.67 / +50.5%
tpch_q04/duckdb:parquet 232261554 / 330679808 / -29.8% 329696318 / 323966569 / +1.8% 0.70 / 1.02 / -31.0%
tpch_q05/duckdb:parquet 523194792 / 676122992 / -22.6% 636753925 / 590865544 / +7.8% 0.82 / 1.14 / -28.2%
tpch_q06/duckdb:parquet 179385222 / 157468941 / +13.9% 215573785 / 197126998 / +9.4% 0.83 / 0.80 / +4.2%
tpch_q07/duckdb:parquet 508560223 / 477530383 / +6.5% 529109974 / 533450062 / -0.8% 0.96 / 0.90 / +7.4%
tpch_q08/duckdb:parquet 643874217 / 646504452 / -0.4% 659843140 / 835751089 / -21.0% 0.98 / 0.77 / +26.1%
tpch_q09/duckdb:parquet 579099919 / 626153529 / -7.5% 651304723 / 639767648 / +1.8% 0.89 / 0.98 / -9.2%
tpch_q10/duckdb:parquet 808744238 / 607719926 / +33.1% 🔴 725052068 / 951523633 / -23.8% 1.12 / 0.64 / +74.6%
tpch_q11/duckdb:parquet 303634051 / 436225398 / -30.4% 🟢 368076597 / 445707137 / -17.4% 0.82 / 0.98 / -15.7%
tpch_q12/duckdb:parquet 288771297 / 319723927 / -9.7% 423239481 / 319906400 / +32.3% 🔴 0.68 / 1.00 / -31.7%
tpch_q13/duckdb:parquet 375569900 / 378466711 / -0.8% 458872149 / 458773177 / +0.0% 0.82 / 0.82 / -0.8%
tpch_q14/duckdb:parquet 323401967 / 307404514 / +5.2% 380041095 / 316250601 / +20.2% 0.85 / 0.97 / -12.5%
tpch_q15/duckdb:parquet 227234681 / 244575083 / -7.1% 278489318 / 370811315 / -24.9% 0.82 / 0.66 / +23.7%
tpch_q16/duckdb:parquet 315963264 / 298710274 / +5.8% 327049917 / 292472556 / +11.8% 0.97 / 1.02 / -5.4%
tpch_q17/duckdb:parquet 284788782 / 250452045 / +13.7% 361470628 / 283203481 / +27.6% 0.79 / 0.88 / -10.9%
tpch_q18/duckdb:parquet 372122290 / 427513949 / -13.0% 397825488 / 426623875 / -6.8% 0.94 / 1.00 / -6.7%
tpch_q19/duckdb:parquet 312684102 / 408538189 / -23.5% 357606636 / 391343605 / -8.6% 0.87 / 1.04 / -16.2%
tpch_q20/duckdb:parquet 700964481 / 453048294 / +54.7% 🔴 741000367 / 487869548 / +51.9% 🔴 0.95 / 0.93 / +1.9%
tpch_q21/duckdb:parquet 475251688 / 483385120 / -1.7% 549643137 / 516982934 / +6.3% 0.86 / 0.94 / -7.5%
tpch_q22/duckdb:parquet 309472899 / 290909423 / +6.4% 351150161 / 381030580 / -7.8% 0.88 / 0.76 / +15.4%

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Vortex queries 📖

Commits: PR ab06f552 vs base e148f028
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (-0.5%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 1.003x ➖ · cold 0.860x ✅
Parquet (geomean): hot 1.003x ➖ · cold 0.964x ➖
Shifts: Parquet (control) +0.3% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:vortex-file-compressed 145522928 / 145665377 / -0.1% 501216667 / 499024072 / +0.4% 0.29 / 0.29 / -0.5%
vortex_q01/datafusion:vortex-file-compressed 111850388 / 112118487 / -0.2% 373918236 / 363312800 / +2.9% 0.30 / 0.31 / -3.1%
vortex_q02/datafusion:vortex-file-compressed 172644061 / 171509488 / +0.7% 320932578 / 298123264 / +7.7% 0.54 / 0.58 / -6.5%
datafusion / parquet / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/datafusion:parquet 135278754 / 134180839 / +0.8% 1214346842 / 1286742777 / -5.6% 0.11 / 0.10 / +6.8%
vortex_q01/datafusion:parquet 70044637 / 70003283 / +0.1% 101705790 / 117936817 / -13.8% 🟢 0.69 / 0.59 / +16.0%
vortex_q02/datafusion:parquet 291644843 / 289240663 / +0.8% 757303913 / 751837126 / +0.7% 0.39 / 0.38 / +0.1%
duckdb / vortex-file-compressed / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:vortex-file-compressed 202934203 / 204041075 / -0.5% 759517023 / 1003257530 / -24.3% 🟢 0.27 / 0.20 / +31.4%
vortex_q01/duckdb:vortex-file-compressed 140291475 / 138744364 / +1.1% 415426378 / 585374436 / -29.0% 🟢 0.34 / 0.24 / +42.5%
vortex_q02/duckdb:vortex-file-compressed 201353713 / 200045725 / +0.7% 396087567 / 584580899 / -32.2% 🟢 0.51 / 0.34 / +48.6%
duckdb / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
vortex_q00/duckdb:parquet 288303105 / 287661836 / +0.2% 966803079 / 927766721 / +4.2% 0.30 / 0.31 / -3.8%
vortex_q01/duckdb:parquet 171277396 / 171077619 / +0.1% 182681312 / 183959335 / -0.7% 0.94 / 0.93 / +0.8%
vortex_q02/duckdb:parquet 351953532 / 351976594 / -0.0% 677076046 / 715597679 / -5.4% 0.52 / 0.49 / +5.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ab06f552 vs base f3aef93b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-0.6%, low confidence)
Vortex (geomean): hot 0.988x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.989x ➖ · cold 1.072x ➖
Shifts: Parquet (control) -1.1% · Median polish -0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.992x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6638162 / 6946321 / -4.4% 17453387 / 17074995 / +2.2% 0.38 / 0.41 / -6.5%
fineweb_q01/datafusion:vortex-file-compressed 8247910 / 10073051 / -18.1% 🟢 42418591 / 40705351 / +4.2% 0.19 / 0.25 / -21.4%
fineweb_q02/datafusion:vortex-file-compressed 9603072 / 9598118 / +0.1% 45895955 / 46304127 / -0.9% 0.21 / 0.21 / +0.9%
fineweb_q03/datafusion:vortex-file-compressed 19522336 / 19538256 / -0.1% 112088095 / 92747891 / +20.9% 🔴 0.17 / 0.21 / -17.3%
fineweb_q04/datafusion:vortex-file-compressed 66195246 / 66882982 / -1.0% 157422257 / 144175384 / +9.2% 0.42 / 0.46 / -9.4%
fineweb_q05/datafusion:vortex-file-compressed 68121929 / 67083012 / +1.5% 147323492 / 136905075 / +7.6% 0.46 / 0.49 / -5.6%
fineweb_q06/datafusion:vortex-file-compressed 20116104 / 19135684 / +5.1% 110289378 / 99061726 / +11.3% 🔴 0.18 / 0.19 / -5.6%
fineweb_q07/datafusion:vortex-file-compressed 18501620 / 17442118 / +6.1% 108540123 / 97115876 / +11.8% 🔴 0.17 / 0.18 / -5.1%
fineweb_q08/datafusion:vortex-file-compressed 9395332 / 8887333 / +5.7% 44600703 / 50785370 / -12.2% 🟢 0.21 / 0.17 / +20.4%
datafusion / vortex-compact / ns (0.994x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 6997828 / 7060978 / -0.9% 17086511 / 16872857 / +1.3% 0.41 / 0.42 / -2.1%
fineweb_q01/datafusion:vortex-compact 42827530 / 42873692 / -0.1% 77706935 / 74401983 / +4.4% 0.55 / 0.58 / -4.4%
fineweb_q02/datafusion:vortex-compact 44349673 / 43370220 / +2.3% 78679982 / 77855508 / +1.1% 0.56 / 0.56 / +1.2%
fineweb_q03/datafusion:vortex-compact 162982410 / 156188786 / +4.3% 230796522 / 216696684 / +6.5% 0.71 / 0.72 / -2.0%
fineweb_q04/datafusion:vortex-compact 173567741 / 162126603 / +7.1% 264671226 / 239090000 / +10.7% 🔴 0.66 / 0.68 / -3.3%
fineweb_q05/datafusion:vortex-compact 164907113 / 164646724 / +0.2% 240679271 / 230761734 / +4.3% 0.69 / 0.71 / -4.0%
fineweb_q06/datafusion:vortex-compact 86653756 / 86463710 / +0.2% 160719687 / 155682439 / +3.2% 0.54 / 0.56 / -2.9%
fineweb_q07/datafusion:vortex-compact 86916666 / 88094020 / -1.3% 155132414 / 154088551 / +0.7% 0.56 / 0.57 / -2.0%
fineweb_q08/datafusion:vortex-compact 7980398 / 9437340 / -15.4% 🟢 35903942 / 36411365 / -1.4% 0.22 / 0.26 / -14.2%
datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9268210 / 9405586 / -1.5% 34067680 / 34361992 / -0.9% 0.27 / 0.27 / -0.6%
fineweb_q01/datafusion:parquet 74653962 / 75947128 / -1.7% 172472785 / 148159236 / +16.4% 🔴 0.43 / 0.51 / -15.6%
fineweb_q02/datafusion:parquet 74067030 / 75827417 / -2.3% 173532833 / 138346227 / +25.4% 🔴 0.43 / 0.55 / -22.1%
fineweb_q03/datafusion:parquet 73912436 / 74921700 / -1.3% 163507808 / 146626013 / +11.5% 🔴 0.45 / 0.51 / -11.5%
fineweb_q04/datafusion:parquet 82042934 / 82119495 / -0.1% 166807503 / 147338344 / +13.2% 🔴 0.49 / 0.56 / -11.8%
fineweb_q05/datafusion:parquet 80292592 / 79898914 / +0.5% 172232197 / 137074313 / +25.6% 🔴 0.47 / 0.58 / -20.0%
fineweb_q06/datafusion:parquet 75091566 / 75392190 / -0.4% 173367162 / 154257489 / +12.4% 🔴 0.43 / 0.49 / -11.4%
fineweb_q07/datafusion:parquet 74323788 / 75229640 / -1.2% 168291331 / 144490981 / +16.5% 🔴 0.44 / 0.52 / -15.2%
fineweb_q08/datafusion:parquet 72802476 / 73764790 / -1.3% 159850501 / 141352340 / +13.1% 🔴 0.46 / 0.52 / -12.7%
duckdb / vortex-file-compressed / ns (0.992x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2027646 / 2014390 / +0.7% 7232497 / 7626734 / -5.2% 0.28 / 0.26 / +6.1%
fineweb_q01/duckdb:vortex-file-compressed 9530591 / 9510797 / +0.2% 32352559 / 31459192 / +2.8% 0.29 / 0.30 / -2.6%
fineweb_q02/duckdb:vortex-file-compressed 10756014 / 10796553 / -0.4% 33418350 / 32599344 / +2.5% 0.32 / 0.33 / -2.8%
fineweb_q03/duckdb:vortex-file-compressed 18704874 / 19090028 / -2.0% 93945955 / 87075464 / +7.9% 0.20 / 0.22 / -9.2%
fineweb_q04/duckdb:vortex-file-compressed 66935422 / 66361364 / +0.9% 106867458 / 105013689 / +1.8% 0.63 / 0.63 / -0.9%
fineweb_q05/duckdb:vortex-file-compressed 65448342 / 66068143 / -0.9% 105442460 / 103851547 / +1.5% 0.62 / 0.64 / -2.4%
fineweb_q06/duckdb:vortex-file-compressed 19205138 / 19131372 / +0.4% 96225175 / 91205383 / +5.5% 0.20 / 0.21 / -4.9%
fineweb_q07/duckdb:vortex-file-compressed 18226722 / 18816068 / -3.1% 89726023 / 86471661 / +3.8% 0.20 / 0.22 / -6.6%
fineweb_q08/duckdb:vortex-file-compressed 5451615 / 5585515 / -2.4% 12840177 / 15490964 / -17.1% 🟢 0.42 / 0.36 / +17.8%
duckdb / vortex-compact / ns (0.972x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 2140684 / 2270160 / -5.7% 7654632 / 7186857 / +6.5% 0.28 / 0.32 / -11.5%
fineweb_q01/duckdb:vortex-compact 43151584 / 43475662 / -0.7% 67468836 / 65445163 / +3.1% 0.64 / 0.66 / -3.7%
fineweb_q02/duckdb:vortex-compact 43639630 / 44527367 / -2.0% 66531909 / 65931051 / +0.9% 0.66 / 0.68 / -2.9%
fineweb_q03/duckdb:vortex-compact 177808758 / 184649669 / -3.7% 223254747 / 204828553 / +9.0% 0.80 / 0.90 / -11.7%
fineweb_q04/duckdb:vortex-compact 193491742 / 192515152 / +0.5% 235836554 / 231262309 / +2.0% 0.82 / 0.83 / -1.4%
fineweb_q05/duckdb:vortex-compact 175475477 / 183189099 / -4.2% 208408606 / 236135728 / -11.7% 🟢 0.84 / 0.78 / +8.5%
fineweb_q06/duckdb:vortex-compact 88237656 / 88275438 / -0.0% 135801107 / 140742310 / -3.5% 0.65 / 0.63 / +3.6%
fineweb_q07/duckdb:vortex-compact 88290826 / 89224566 / -1.0% 136293714 / 133769546 / +1.9% 0.65 / 0.67 / -2.9%
fineweb_q08/duckdb:vortex-compact 5346227 / 5794698 / -7.7% 11880740 / 11319951 / +5.0% 0.45 / 0.51 / -12.1%
duckdb / parquet / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 23740945 / 23936880 / -0.8% 27651250 / 28295326 / -2.3% 0.86 / 0.85 / +1.5%
fineweb_q01/duckdb:parquet 55308017 / 56868110 / -2.7% 78685178 / 78505979 / +0.2% 0.70 / 0.72 / -3.0%
fineweb_q02/duckdb:parquet 59425074 / 59873466 / -0.7% 81845018 / 81905442 / -0.1% 0.73 / 0.73 / -0.7%
fineweb_q03/duckdb:parquet 118119190 / 118869836 / -0.6% 182052957 / 179504855 / +1.4% 0.65 / 0.66 / -2.0%
fineweb_q04/duckdb:parquet 158305371 / 162831614 / -2.8% 221011893 / 209747663 / +5.4% 0.72 / 0.78 / -7.7%
fineweb_q05/duckdb:parquet 159264840 / 157315417 / +1.2% 206749094 / 208473152 / -0.8% 0.77 / 0.75 / +2.1%
fineweb_q06/duckdb:parquet 86184263 / 87890970 / -1.9% 154353533 / 154154619 / +0.1% 0.56 / 0.57 / -2.1%
fineweb_q07/duckdb:parquet 90791980 / 90282977 / +0.6% 144938952 / 147333123 / -1.6% 0.63 / 0.61 / +2.2%
fineweb_q08/duckdb:parquet 29237000 / 29943474 / -2.4% 30883233 / 30883948 / -0.0% 0.95 / 0.97 / -2.4%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ab06f552 vs base e148f028
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 1.005x ➖ · cold 1.003x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.005x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15440659 / 15407389 / +0.2% 45766672 / 44913654 / +1.9% 0.34 / 0.34 / -1.7%
tpch_q02/datafusion:vortex-file-compressed 16676603 / 16838339 / -1.0% 37901583 / 37708004 / +0.5% 0.44 / 0.45 / -1.5%
tpch_q03/datafusion:vortex-file-compressed 19961304 / 19569722 / +2.0% 52024556 / 51448100 / +1.1% 0.38 / 0.38 / +0.9%
tpch_q04/datafusion:vortex-file-compressed 10255608 / 10484144 / -2.2% 38117129 / 40428103 / -5.7% 0.27 / 0.26 / +3.8%
tpch_q05/datafusion:vortex-file-compressed 37626690 / 36887205 / +2.0% 67396214 / 67618015 / -0.3% 0.56 / 0.55 / +2.3%
tpch_q06/datafusion:vortex-file-compressed 6150824 / 5925316 / +3.8% 28515227 / 32062507 / -11.1% 🟢 0.22 / 0.18 / +16.7%
tpch_q07/datafusion:vortex-file-compressed 51898247 / 52226094 / -0.6% 83928266 / 83378180 / +0.7% 0.62 / 0.63 / -1.3%
tpch_q08/datafusion:vortex-file-compressed 51515153 / 51049411 / +0.9% 84559985 / 83894953 / +0.8% 0.61 / 0.61 / +0.1%
tpch_q09/datafusion:vortex-file-compressed 47825228 / 47823649 / +0.0% 78240647 / 80066023 / -2.3% 0.61 / 0.60 / +2.3%
tpch_q10/datafusion:vortex-file-compressed 17388202 / 17541834 / -0.9% 55238072 / 52653886 / +4.9% 0.31 / 0.33 / -5.5%
tpch_q11/datafusion:vortex-file-compressed 14282856 / 14211660 / +0.5% 34785707 / 35528059 / -2.1% 0.41 / 0.40 / +2.6%
tpch_q12/datafusion:vortex-file-compressed 18259355 / 18231642 / +0.2% 46876713 / 42677303 / +9.8% 0.39 / 0.43 / -8.8%
tpch_q13/datafusion:vortex-file-compressed 19567517 / 19688936 / -0.6% 43025026 / 39315004 / +9.4% 0.45 / 0.50 / -9.2%
tpch_q14/datafusion:vortex-file-compressed 14469999 / 14497507 / -0.2% 38094311 / 39918311 / -4.6% 0.38 / 0.36 / +4.6%
tpch_q15/datafusion:vortex-file-compressed 18758451 / 18701261 / +0.3% 44904433 / 44293808 / +1.4% 0.42 / 0.42 / -1.1%
tpch_q16/datafusion:vortex-file-compressed 18270708 / 18687041 / -2.2% 39602068 / 38849237 / +1.9% 0.46 / 0.48 / -4.1%
tpch_q17/datafusion:vortex-file-compressed 27775777 / 28478080 / -2.5% 58393280 / 60350755 / -3.2% 0.48 / 0.47 / +0.8%
tpch_q18/datafusion:vortex-file-compressed 36004889 / 36314784 / -0.9% 57085529 / 57895418 / -1.4% 0.63 / 0.63 / +0.6%
tpch_q19/datafusion:vortex-file-compressed 11893618 / 11877959 / +0.1% 39960837 / 38547695 / +3.7% 0.30 / 0.31 / -3.4%
tpch_q20/datafusion:vortex-file-compressed 20518316 / 20350655 / +0.8% 45719479 / 43684590 / +4.7% 0.45 / 0.47 / -3.7%
tpch_q21/datafusion:vortex-file-compressed 39721654 / 40085654 / -0.9% 71513379 / 73171983 / -2.3% 0.56 / 0.55 / +1.4%
tpch_q22/datafusion:vortex-file-compressed 10880033 / 10828508 / +0.5% 32483921 / 31400658 / +3.4% 0.33 / 0.34 / -2.9%
datafusion / vortex-compact / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 16436720 / 15969288 / +2.9% 44181943 / 44446756 / -0.6% 0.37 / 0.36 / +3.5%
tpch_q02/datafusion:vortex-compact 18424291 / 18078889 / +1.9% 36663930 / 36094776 / +1.6% 0.50 / 0.50 / +0.3%
tpch_q03/datafusion:vortex-compact 20418962 / 20044946 / +1.9% 47308062 / 46906761 / +0.9% 0.43 / 0.43 / +1.0%
tpch_q04/datafusion:vortex-compact 11261295 / 11246049 / +0.1% 33275283 / 31910549 / +4.3% 0.34 / 0.35 / -4.0%
tpch_q05/datafusion:vortex-compact 37737149 / 37978566 / -0.6% 67470213 / 66877853 / +0.9% 0.56 / 0.57 / -1.5%
tpch_q06/datafusion:vortex-compact 6994605 / 6746568 / +3.7% 29677272 / 28950101 / +2.5% 0.24 / 0.23 / +1.1%
tpch_q07/datafusion:vortex-compact 53534355 / 53063388 / +0.9% 78941278 / 80913070 / -2.4% 0.68 / 0.66 / +3.4%
tpch_q08/datafusion:vortex-compact 52199002 / 51924186 / +0.5% 73144000 / 78619096 / -7.0% 0.71 / 0.66 / +8.1%
tpch_q09/datafusion:vortex-compact 48167801 / 48829224 / -1.4% 76315231 / 74298654 / +2.7% 0.63 / 0.66 / -4.0%
tpch_q10/datafusion:vortex-compact 19689448 / 19443455 / +1.3% 48313120 / 49185411 / -1.8% 0.41 / 0.40 / +3.1%
tpch_q11/datafusion:vortex-compact 14529913 / 14676576 / -1.0% 33992495 / 34610376 / -1.8% 0.43 / 0.42 / +0.8%
tpch_q12/datafusion:vortex-compact 19688121 / 20003408 / -1.6% 43938377 / 42719816 / +2.9% 0.45 / 0.47 / -4.3%
tpch_q13/datafusion:vortex-compact 20226200 / 19940844 / +1.4% 42923524 / 39560282 / +8.5% 0.47 / 0.50 / -6.5%
tpch_q14/datafusion:vortex-compact 15562021 / 15818943 / -1.6% 41696347 / 40274269 / +3.5% 0.37 / 0.39 / -5.0%
tpch_q15/datafusion:vortex-compact 20088406 / 20137585 / -0.2% 45332436 / 47047205 / -3.6% 0.44 / 0.43 / +3.5%
tpch_q16/datafusion:vortex-compact 19106066 / 18864450 / +1.3% 40021693 / 39983813 / +0.1% 0.48 / 0.47 / +1.2%
tpch_q17/datafusion:vortex-compact 28553525 / 28461548 / +0.3% 57994347 / 61310199 / -5.4% 0.49 / 0.46 / +6.1%
tpch_q18/datafusion:vortex-compact 35867398 / 35995108 / -0.4% 59122490 / 59202693 / -0.1% 0.61 / 0.61 / -0.2%
tpch_q19/datafusion:vortex-compact 14423120 / 13625750 / +5.9% 40768567 / 42221758 / -3.4% 0.35 / 0.32 / +9.6%
tpch_q20/datafusion:vortex-compact 21251382 / 21266909 / -0.1% 47989725 / 44988588 / +6.7% 0.44 / 0.47 / -6.3%
tpch_q21/datafusion:vortex-compact 41660633 / 41215947 / +1.1% 73297787 / 71132506 / +3.0% 0.57 / 0.58 / -1.9%
tpch_q22/datafusion:vortex-compact 11129102 / 11290701 / -1.4% 31176446 / 31821036 / -2.0% 0.36 / 0.35 / +0.6%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 72143963 / 72375324 / -0.3% 91166761 / 89750534 / +1.6% 0.79 / 0.81 / -1.9%
tpch_q02/datafusion:parquet 76558582 / 75390821 / +1.5% 93788403 / 94029712 / -0.3% 0.82 / 0.80 / +1.8%
tpch_q03/datafusion:parquet 83655466 / 83262976 / +0.5% 107093938 / 108068305 / -0.9% 0.78 / 0.77 / +1.4%
tpch_q04/datafusion:parquet 40760687 / 40743583 / +0.0% 64204479 / 61228607 / +4.9% 0.63 / 0.67 / -4.6%
tpch_q05/datafusion:parquet 112234310 / 112265036 / -0.0% 142288328 / 141457781 / +0.6% 0.79 / 0.79 / -0.6%
tpch_q06/datafusion:parquet 32055409 / 32141882 / -0.3% 50494161 / 50024302 / +0.9% 0.63 / 0.64 / -1.2%
tpch_q07/datafusion:parquet 115230586 / 114951484 / +0.2% 140601623 / 143018349 / -1.7% 0.82 / 0.80 / +2.0%
tpch_q08/datafusion:parquet 119511595 / 119819004 / -0.3% 150970437 / 148038223 / +2.0% 0.79 / 0.81 / -2.2%
tpch_q09/datafusion:parquet 139931006 / 139893380 / +0.0% 168560522 / 168774811 / -0.1% 0.83 / 0.83 / +0.2%
tpch_q10/datafusion:parquet 106828498 / 106488958 / +0.3% 132416144 / 134339329 / -1.4% 0.81 / 0.79 / +1.8%
tpch_q11/datafusion:parquet 61008797 / 61796879 / -1.3% 84063575 / 82844797 / +1.5% 0.73 / 0.75 / -2.7%
tpch_q12/datafusion:parquet 65409214 / 65344562 / +0.1% 92007557 / 87421837 / +5.2% 0.71 / 0.75 / -4.9%
tpch_q13/datafusion:parquet 146993085 / 147059889 / -0.0% 170331544 / 169982372 / +0.2% 0.86 / 0.87 / -0.3%
tpch_q14/datafusion:parquet 47395628 / 47809779 / -0.9% 73755494 / 71968558 / +2.5% 0.64 / 0.66 / -3.3%
tpch_q15/datafusion:parquet 74313962 / 74779673 / -0.6% 98944642 / 97282245 / +1.7% 0.75 / 0.77 / -2.3%
tpch_q16/datafusion:parquet 44663591 / 43838361 / +1.9% 61928034 / 64113491 / -3.4% 0.72 / 0.68 / +5.5%
tpch_q17/datafusion:parquet 123345367 / 124618611 / -1.0% 147937016 / 147679902 / +0.2% 0.83 / 0.84 / -1.2%
tpch_q18/datafusion:parquet 123827388 / 123778811 / +0.0% 148812536 / 145794200 / +2.1% 0.83 / 0.85 / -2.0%
tpch_q19/datafusion:parquet 57667468 / 57971100 / -0.5% 85932599 / 83379620 / +3.1% 0.67 / 0.70 / -3.5%
tpch_q20/datafusion:parquet 79546812 / 79131962 / +0.5% 103490381 / 103734545 / -0.2% 0.77 / 0.76 / +0.8%
tpch_q21/datafusion:parquet 117384580 / 116389345 / +0.9% 142837631 / 144470567 / -1.1% 0.82 / 0.81 / +2.0%
tpch_q22/datafusion:parquet 51823679 / 51810618 / +0.0% 70616487 / 69027734 / +2.3% 0.73 / 0.75 / -2.2%
duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 9408654 / 9004137 / +4.5% 19716790 / 20613024 / -4.3% 0.48 / 0.44 / +9.2%
tpch_q02/duckdb:vortex-file-compressed 15766396 / 15448578 / +2.1% 24778075 / 25364360 / -2.3% 0.64 / 0.61 / +4.5%
tpch_q03/duckdb:vortex-file-compressed 18257056 / 18272698 / -0.1% 33494445 / 33792401 / -0.9% 0.55 / 0.54 / +0.8%
tpch_q04/duckdb:vortex-file-compressed 12637413 / 12047984 / +4.9% 25365127 / 24565618 / +3.3% 0.50 / 0.49 / +1.6%
tpch_q05/duckdb:vortex-file-compressed 20468214 / 20292275 / +0.9% 33572136 / 34290523 / -2.1% 0.61 / 0.59 / +3.0%
tpch_q06/duckdb:vortex-file-compressed 4780934 / 4775784 / +0.1% 14224640 / 15299120 / -7.0% 0.34 / 0.31 / +7.7%
tpch_q07/duckdb:vortex-file-compressed 24021298 / 24084120 / -0.3% 39100321 / 38547668 / +1.4% 0.61 / 0.62 / -1.7%
tpch_q08/duckdb:vortex-file-compressed 21447992 / 21510191 / -0.3% 36747034 / 37868196 / -3.0% 0.58 / 0.57 / +2.8%
tpch_q09/duckdb:vortex-file-compressed 21754421 / 21305018 / +2.1% 37203516 / 37872831 / -1.8% 0.58 / 0.56 / +3.9%
tpch_q10/duckdb:vortex-file-compressed 27742189 / 27039875 / +2.6% 42115527 / 42825156 / -1.7% 0.66 / 0.63 / +4.3%
tpch_q11/duckdb:vortex-file-compressed 8386566 / 8315887 / +0.8% 17628819 / 17043055 / +3.4% 0.48 / 0.49 / -2.5%
tpch_q12/duckdb:vortex-file-compressed 14296570 / 14036690 / +1.9% 27476373 / 27890557 / -1.5% 0.52 / 0.50 / +3.4%
tpch_q13/duckdb:vortex-file-compressed 23053985 / 23337422 / -1.2% 31943334 / 32880476 / -2.9% 0.72 / 0.71 / +1.7%
tpch_q14/duckdb:vortex-file-compressed 11650492 / 11423170 / +2.0% 24294087 / 24452805 / -0.6% 0.48 / 0.47 / +2.7%
tpch_q15/duckdb:vortex-file-compressed 8493656 / 8601680 / -1.3% 20052202 / 19423479 / +3.2% 0.42 / 0.44 / -4.4%
tpch_q16/duckdb:vortex-file-compressed 16538741 / 16622594 / -0.5% 23465227 / 23274384 / +0.8% 0.70 / 0.71 / -1.3%
tpch_q17/duckdb:vortex-file-compressed 12264648 / 11928903 / +2.8% 25532867 / 25517419 / +0.1% 0.48 / 0.47 / +2.8%
tpch_q18/duckdb:vortex-file-compressed 23750631 / 23989967 / -1.0% 33543084 / 32906062 / +1.9% 0.71 / 0.73 / -2.9%
tpch_q19/duckdb:vortex-file-compressed 11229711 / 11265566 / -0.3% 23086520 / 24160967 / -4.4% 0.49 / 0.47 / +4.3%
tpch_q20/duckdb:vortex-file-compressed 13936286 / 14059085 / -0.9% 29854669 / 28929380 / +3.2% 0.47 / 0.49 / -3.9%
tpch_q21/duckdb:vortex-file-compressed 36845539 / 36603469 / +0.7% 55155291 / 55960593 / -1.4% 0.67 / 0.65 / +2.1%
tpch_q22/duckdb:vortex-file-compressed 19179923 / 19155482 / +0.1% 29576958 / 29411656 / +0.6% 0.65 / 0.65 / -0.4%
duckdb / vortex-compact / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 9287478 / 9167183 / +1.3% 21870528 / 21783661 / +0.4% 0.42 / 0.42 / +0.9%
tpch_q02/duckdb:vortex-compact 18962546 / 18919598 / +0.2% 27547802 / 26964116 / +2.2% 0.69 / 0.70 / -1.9%
tpch_q03/duckdb:vortex-compact 19102956 / 19536713 / -2.2% 34097765 / 35081930 / -2.8% 0.56 / 0.56 / +0.6%
tpch_q04/duckdb:vortex-compact 13060732 / 12836674 / +1.7% 25447836 / 26838962 / -5.2% 0.51 / 0.48 / +7.3%
tpch_q05/duckdb:vortex-compact 21669044 / 21297729 / +1.7% 33528969 / 32189738 / +4.2% 0.65 / 0.66 / -2.3%
tpch_q06/duckdb:vortex-compact 5404239 / 5167316 / +4.6% 15487806 / 15697933 / -1.3% 0.35 / 0.33 / +6.0%
tpch_q07/duckdb:vortex-compact 25618541 / 25110560 / +2.0% 40907567 / 40618464 / +0.7% 0.63 / 0.62 / +1.3%
tpch_q08/duckdb:vortex-compact 22944931 / 22473903 / +2.1% 37648437 / 37146294 / +1.4% 0.61 / 0.61 / +0.7%
tpch_q09/duckdb:vortex-compact 26358435 / 27216000 / -3.2% 43501739 / 38151914 / +14.0% 🔴 0.61 / 0.71 / -15.1%
tpch_q10/duckdb:vortex-compact 38077523 / 37601118 / +1.3% 51910413 / 51665712 / +0.5% 0.73 / 0.73 / +0.8%
tpch_q11/duckdb:vortex-compact 8759661 / 8610964 / +1.7% 17438836 / 17937753 / -2.8% 0.50 / 0.48 / +4.6%
tpch_q12/duckdb:vortex-compact 17651336 / 17444224 / +1.2% 28341907 / 29369902 / -3.5% 0.62 / 0.59 / +4.9%
tpch_q13/duckdb:vortex-compact 26253157 / 26636696 / -1.4% 34769603 / 35146876 / -1.1% 0.76 / 0.76 / -0.4%
tpch_q14/duckdb:vortex-compact 12507251 / 12481830 / +0.2% 25516544 / 25354118 / +0.6% 0.49 / 0.49 / -0.4%
tpch_q15/duckdb:vortex-compact 9562434 / 9847935 / -2.9% 22919039 / 22289274 / +2.8% 0.42 / 0.44 / -5.6%
tpch_q16/duckdb:vortex-compact 17426103 / 17360581 / +0.4% 24474600 / 23038994 / +6.2% 0.71 / 0.75 / -5.5%
tpch_q17/duckdb:vortex-compact 12853946 / 13005899 / -1.2% 28071877 / 28001683 / +0.3% 0.46 / 0.46 / -1.4%
tpch_q18/duckdb:vortex-compact 24127016 / 24354902 / -0.9% 34148809 / 32389715 / +5.4% 0.71 / 0.75 / -6.0%
tpch_q19/duckdb:vortex-compact 14499435 / 14270208 / +1.6% 27582284 / 27952519 / -1.3% 0.53 / 0.51 / +3.0%
tpch_q20/duckdb:vortex-compact 19483207 / 19390797 / +0.5% 33483914 / 32542169 / +2.9% 0.58 / 0.60 / -2.3%
tpch_q21/duckdb:vortex-compact 38846694 / 37260983 / +4.3% 54323417 / 55161778 / -1.5% 0.72 / 0.68 / +5.9%
tpch_q22/duckdb:vortex-compact 23600472 / 23486175 / +0.5% 34453812 / 33310268 / +3.4% 0.68 / 0.71 / -2.8%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48205486 / 48308139 / -0.2% 54857532 / 55035342 / -0.3% 0.88 / 0.88 / +0.1%
tpch_q02/duckdb:parquet 48834940 / 48806237 / +0.1% 56212060 / 56168768 / +0.1% 0.87 / 0.87 / -0.0%
tpch_q03/duckdb:parquet 60608984 / 60844054 / -0.4% 69838241 / 70087651 / -0.4% 0.87 / 0.87 / -0.0%
tpch_q04/duckdb:parquet 35069661 / 35210608 / -0.4% 43635051 / 44377824 / -1.7% 0.80 / 0.79 / +1.3%
tpch_q05/duckdb:parquet 67787768 / 67592187 / +0.3% 77691426 / 77868787 / -0.2% 0.87 / 0.87 / +0.5%
tpch_q06/duckdb:parquet 21868419 / 22033408 / -0.7% 28341556 / 27719166 / +2.2% 0.77 / 0.79 / -2.9%
tpch_q07/duckdb:parquet 64119454 / 64641782 / -0.8% 74807262 / 74347954 / +0.6% 0.86 / 0.87 / -1.4%
tpch_q08/duckdb:parquet 76362920 / 76064765 / +0.4% 87727648 / 87822103 / -0.1% 0.87 / 0.87 / +0.5%
tpch_q09/duckdb:parquet 108368726 / 108492436 / -0.1% 120076135 / 120822140 / -0.6% 0.90 / 0.90 / +0.5%
tpch_q10/duckdb:parquet 106650351 / 106643256 / +0.0% 120023217 / 119800743 / +0.2% 0.89 / 0.89 / -0.2%
tpch_q11/duckdb:parquet 29790618 / 29844678 / -0.2% 35263972 / 35763567 / -1.4% 0.84 / 0.83 / +1.2%
tpch_q12/duckdb:parquet 37899488 / 38069364 / -0.4% 45487743 / 45299762 / +0.4% 0.83 / 0.84 / -0.9%
tpch_q13/duckdb:parquet 175448967 / 176284029 / -0.5% 182834075 / 184032924 / -0.7% 0.96 / 0.96 / +0.2%
tpch_q14/duckdb:parquet 42838847 / 42863906 / -0.1% 52118242 / 52487444 / -0.7% 0.82 / 0.82 / +0.6%
tpch_q15/duckdb:parquet 32940894 / 32930702 / +0.0% 42006542 / 42159837 / -0.4% 0.78 / 0.78 / +0.4%
tpch_q16/duckdb:parquet 47878182 / 47962162 / -0.2% 53324891 / 53653166 / -0.6% 0.90 / 0.89 / +0.4%
tpch_q17/duckdb:parquet 48399935 / 48129378 / +0.6% 57632521 / 58094923 / -0.8% 0.84 / 0.83 / +1.4%
tpch_q18/duckdb:parquet 74653307 / 74700904 / -0.1% 82905422 / 81192863 / +2.1% 0.90 / 0.92 / -2.1%
tpch_q19/duckdb:parquet 47881358 / 49785066 / -3.8% 59553663 / 56376186 / +5.6% 0.80 / 0.88 / -9.0%
tpch_q20/duckdb:parquet 63799135 / 63726724 / +0.1% 74347384 / 74797864 / -0.6% 0.86 / 0.85 / +0.7%
tpch_q21/duckdb:parquet 107293325 / 107683378 / -0.4% 117047194 / 117362177 / -0.3% 0.92 / 0.92 / -0.1%
tpch_q22/duckdb:parquet 51050890 / 51145422 / -0.2% 60159063 / 59551886 / +1.0% 0.85 / 0.86 / -1.2%
duckdb / duckdb / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 6700323 / 6496606 / +3.1% 14032799 / 13988203 / +0.3% 0.48 / 0.46 / +2.8%
tpch_q02/duckdb:duckdb 8997282 / 8812021 / +2.1% 17331420 / 17497559 / -0.9% 0.52 / 0.50 / +3.1%
tpch_q03/duckdb:duckdb 15790536 / 15438713 / +2.3% 26330315 / 26445695 / -0.4% 0.60 / 0.58 / +2.7%
tpch_q04/duckdb:duckdb 11338855 / 11380517 / -0.4% 20994985 / 22149901 / -5.2% 0.54 / 0.51 / +5.1%
tpch_q05/duckdb:duckdb 15865663 / 15616662 / +1.6% 26949625 / 27062774 / -0.4% 0.59 / 0.58 / +2.0%
tpch_q06/duckdb:duckdb 3220173 / 3255732 / -1.1% 10101725 / 10149819 / -0.5% 0.32 / 0.32 / -0.6%
tpch_q07/duckdb:duckdb 18367786 / 18576700 / -1.1% 28701839 / 29614466 / -3.1% 0.64 / 0.63 / +2.0%
tpch_q08/duckdb:duckdb 17483760 / 17720906 / -1.3% 30531753 / 30450307 / +0.3% 0.57 / 0.58 / -1.6%
tpch_q09/duckdb:duckdb 23957603 / 24008394 / -0.2% 38296627 / 36540386 / +4.8% 0.63 / 0.66 / -4.8%
tpch_q10/duckdb:duckdb 29895643 / 28954643 / +3.2% 43141056 / 43145740 / -0.0% 0.69 / 0.67 / +3.3%
tpch_q11/duckdb:duckdb 5935793 / 5861555 / +1.3% 12482594 / 12518379 / -0.3% 0.48 / 0.47 / +1.6%
tpch_q12/duckdb:duckdb 10858534 / 10851724 / +0.1% 21400313 / 19521025 / +9.6% 0.51 / 0.56 / -8.7%
tpch_q13/duckdb:duckdb 32331281 / 32440169 / -0.3% 40789115 / 41229932 / -1.1% 0.79 / 0.79 / +0.7%
tpch_q14/duckdb:duckdb 12593354 / 12626418 / -0.3% 21500240 / 22158109 / -3.0% 0.59 / 0.57 / +2.8%
tpch_q15/duckdb:duckdb 6993755 / 7045541 / -0.7% 16458472 / 17190894 / -4.3% 0.42 / 0.41 / +3.7%
tpch_q16/duckdb:duckdb 19268580 / 19065482 / +1.1% 25048683 / 25498408 / -1.8% 0.77 / 0.75 / +2.9%
tpch_q17/duckdb:duckdb 8368599 / 8476119 / -1.3% 18440373 / 19088314 / -3.4% 0.45 / 0.44 / +2.2%
tpch_q18/duckdb:duckdb 18381181 / 18463008 / -0.4% 26114080 / 27572123 / -5.3% 0.70 / 0.67 / +5.1%
tpch_q19/duckdb:duckdb 12955770 / 12993127 / -0.3% 22202583 / 22578174 / -1.7% 0.58 / 0.58 / +1.4%
tpch_q20/duckdb:duckdb 14396163 / 14507098 / -0.8% 27817561 / 27693346 / +0.4% 0.52 / 0.52 / -1.2%
tpch_q21/duckdb:duckdb 22141418 / 22142778 / -0.0% 34010455 / 33757851 / +0.7% 0.65 / 0.66 / -0.7%
tpch_q22/duckdb:duckdb 23512123 / 23561734 / -0.2% 32420323 / 32472866 / -0.2% 0.73 / 0.73 / -0.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ab06f552 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.8%
Engines: DataFusion No clear signal (+3.5%, low confidence) · DuckDB No clear signal (+1.2%, low confidence)
Vortex (geomean): hot 1.030x ➖ · cold 0.913x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.955x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.039x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 197983844 / 158746424 / +24.7% 🔴 570101287 / 555206800 / +2.7% 0.35 / 0.29 / +21.5%
clickbench-sorted_q24/datafusion:vortex-file-compressed 10934505 / 10746098 / +1.8% 44074673 / 49290707 / -10.6% 🟢 0.25 / 0.22 / +13.8%
clickbench-sorted_q26/datafusion:vortex-file-compressed 11421303 / 11117802 / +2.7% 46694472 / 50893696 / -8.3% 0.24 / 0.22 / +12.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed 23555713 / 22819059 / +3.2% 62253224 / 72028201 / -13.6% 🟢 0.38 / 0.32 / +19.4%
clickbench-sorted_q37/datafusion:vortex-file-compressed 18239430 / 18546417 / -1.7% 52944950 / 58397503 / -9.3% 0.34 / 0.32 / +8.5%
clickbench-sorted_q38/datafusion:vortex-file-compressed 17716549 / 17291766 / +2.5% 52993127 / 65575705 / -19.2% 🟢 0.33 / 0.26 / +26.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed 41370036 / 40425256 / +2.3% 86545962 / 96145592 / -10.0% 0.48 / 0.42 / +13.7%
clickbench-sorted_q40/datafusion:vortex-file-compressed 11958054 / 11786662 / +1.5% 37719689 / 48255865 / -21.8% 🟢 0.32 / 0.24 / +29.8%
clickbench-sorted_q41/datafusion:vortex-file-compressed 11435508 / 11423128 / +0.1% 41172595 / 49248370 / -16.4% 🟢 0.28 / 0.23 / +19.7%
clickbench-sorted_q42/datafusion:vortex-file-compressed 10277998 / 9874600 / +4.1% 30946869 / 37117505 / -16.6% 🟢 0.33 / 0.27 / +24.8%
datafusion / parquet / ns (1.004x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 763194648 / 759320076 / +0.5% 956807626 / 972225866 / -1.6% 0.80 / 0.78 / +2.1%
clickbench-sorted_q24/datafusion:parquet 8709751 / 8555404 / +1.8% 69556629 / 75680204 / -8.1% 0.13 / 0.11 / +10.8%
clickbench-sorted_q26/datafusion:parquet 9260846 / 9029181 / +2.6% 69064195 / 76319685 / -9.5% 0.13 / 0.12 / +13.3%
clickbench-sorted_q36/datafusion:parquet 93326919 / 93667916 / -0.4% 163407888 / 173488432 / -5.8% 0.57 / 0.54 / +5.8%
clickbench-sorted_q37/datafusion:parquet 64149893 / 63524298 / +1.0% 126970408 / 133632871 / -5.0% 0.51 / 0.48 / +6.3%
clickbench-sorted_q38/datafusion:parquet 87099356 / 86829124 / +0.3% 156638090 / 165341155 / -5.3% 0.56 / 0.53 / +5.9%
clickbench-sorted_q39/datafusion:parquet 158584124 / 159708713 / -0.7% 228549889 / 240232665 / -4.9% 0.69 / 0.66 / +4.4%
clickbench-sorted_q40/datafusion:parquet 43793646 / 43516079 / +0.6% 105248029 / 116915748 / -10.0% 0.42 / 0.37 / +11.8%
clickbench-sorted_q41/datafusion:parquet 41632466 / 41938291 / -0.7% 103122069 / 111978213 / -7.9% 0.40 / 0.37 / +7.8%
clickbench-sorted_q42/datafusion:parquet 25675072 / 25931174 / -1.0% 82234451 / 89964132 / -8.6% 0.31 / 0.29 / +8.3%
duckdb / vortex-file-compressed / ns (1.022x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 34757682 / 30274908 / +14.8% 🔴 64323833 / 65797790 / -2.2% 0.54 / 0.46 / +17.4%
clickbench-sorted_q24/duckdb:vortex-file-compressed 9387260 / 8818010 / +6.5% 24267533 / 26855490 / -9.6% 0.39 / 0.33 / +17.8%
clickbench-sorted_q26/duckdb:vortex-file-compressed 8335268 / 8676274 / -3.9% 27737441 / 27633987 / +0.4% 0.30 / 0.31 / -4.3%
clickbench-sorted_q36/duckdb:vortex-file-compressed 22005581 / 21720700 / +1.3% 51991703 / 55391772 / -6.1% 0.42 / 0.39 / +7.9%
clickbench-sorted_q37/duckdb:vortex-file-compressed 17054681 / 17000187 / +0.3% 43989206 / 45475284 / -3.3% 0.39 / 0.37 / +3.7%
clickbench-sorted_q38/duckdb:vortex-file-compressed 18514431 / 18389361 / +0.7% 48284582 / 53726504 / -10.1% 🟢 0.38 / 0.34 / +12.0%
clickbench-sorted_q39/duckdb:vortex-file-compressed 39746520 / 39494642 / +0.6% 82419871 / 90132312 / -8.6% 0.48 / 0.44 / +10.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 10854137 / 10667293 / +1.8% 33537096 / 36690034 / -8.6% 0.32 / 0.29 / +11.3%
clickbench-sorted_q41/duckdb:vortex-file-compressed 11674182 / 11569048 / +0.9% 35735348 / 35725111 / +0.0% 0.33 / 0.32 / +0.9%
clickbench-sorted_q42/duckdb:vortex-file-compressed 8169596 / 8173348 / -0.0% 28367979 / 27609936 / +2.7% 0.29 / 0.30 / -2.7%
duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 144029786 / 149419148 / -3.6% 175106583 / 171375462 / +2.2% 0.82 / 0.87 / -5.7%
clickbench-sorted_q24/duckdb:parquet 17596500 / 17497259 / +0.6% 23519379 / 19281477 / +22.0% 🔴 0.75 / 0.91 / -17.6%
clickbench-sorted_q26/duckdb:parquet 19027674 / 18857212 / +0.9% 27013902 / 28555274 / -5.4% 0.70 / 0.66 / +6.7%
clickbench-sorted_q36/duckdb:parquet 50396734 / 49699035 / +1.4% 60585879 / 70551710 / -14.1% 🟢 0.83 / 0.70 / +18.1%
clickbench-sorted_q37/duckdb:parquet 37050874 / 37040306 / +0.0% 47864232 / 47351109 / +1.1% 0.77 / 0.78 / -1.0%
clickbench-sorted_q38/duckdb:parquet 44628576 / 45717295 / -2.4% 57379331 / 65264664 / -12.1% 🟢 0.78 / 0.70 / +11.0%
clickbench-sorted_q39/duckdb:parquet 79411492 / 79421566 / -0.0% 90660490 / 90164853 / +0.5% 0.88 / 0.88 / -0.6%
clickbench-sorted_q40/duckdb:parquet 24187484 / 22807442 / +6.1% 34399440 / 39742195 / -13.4% 🟢 0.70 / 0.57 / +22.5%
clickbench-sorted_q41/duckdb:parquet 23059904 / 24635458 / -6.4% 34016341 / 32804877 / +3.7% 0.68 / 0.75 / -9.7%
clickbench-sorted_q42/duckdb:parquet 19490872 / 19079602 / +2.2% 25918455 / 26567822 / -2.4% 0.75 / 0.72 / +4.7%
duckdb / duckdb / ns (0.998x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:duckdb 76219812 / 77151946 / -1.2% 125931419 / 133144559 / -5.4% 0.61 / 0.58 / +4.5%
clickbench-sorted_q24/duckdb:duckdb 25280408 / 25462628 / -0.7% 29003162 / 31672103 / -8.4% 0.87 / 0.80 / +8.4%
clickbench-sorted_q26/duckdb:duckdb 25806178 / 25144094 / +2.6% 32159006 / 33551856 / -4.2% 0.80 / 0.75 / +7.1%
clickbench-sorted_q36/duckdb:duckdb 41409156 / 42746634 / -3.1% 74031875 / 77448020 / -4.4% 0.56 / 0.55 / +1.3%
clickbench-sorted_q37/duckdb:duckdb 38978299 / 39756558 / -2.0% 83149513 / 77985669 / +6.6% 0.47 / 0.51 / -8.0%
clickbench-sorted_q38/duckdb:duckdb 31849324 / 31681765 / +0.5% 69639773 / 70418100 / -1.1% 0.46 / 0.45 / +1.7%
clickbench-sorted_q39/duckdb:duckdb 56551122 / 54446616 / +3.9% 111762996 / 113656020 / -1.7% 0.51 / 0.48 / +5.6%
clickbench-sorted_q40/duckdb:duckdb 23488984 / 23340990 / +0.6% 47488848 / 48640904 / -2.4% 0.49 / 0.48 / +3.1%
clickbench-sorted_q41/duckdb:duckdb 22432578 / 22438102 / -0.0% 42205956 / 41372875 / +2.0% 0.53 / 0.54 / -2.0%
clickbench-sorted_q42/duckdb:duckdb 17879128 / 18299861 / -2.3% 28710687 / 30140370 / -4.7% 0.62 / 0.61 / +2.6%
File Size Changes (201 files changed, -0.0% overall, 96↑ 105↓)
File Scale Format Base HEAD Change %
hits_061.vortex 1.0 vortex-compact 123.66 MB 125.16 MB +1.51 MB +1.2%
hits_004.vortex 1.0 vortex-compact 97.29 MB 98.16 MB +886.45 KB +0.9%
hits_027.vortex 1.0 vortex-file-compressed 189.49 MB 191.12 MB +1.63 MB +0.9%
hits_087.vortex 1.0 vortex-file-compressed 160.30 MB 161.58 MB +1.28 MB +0.8%
hits_078.vortex 1.0 vortex-compact 96.98 MB 97.69 MB +726.90 KB +0.7%
hits_027.vortex 1.0 vortex-compact 138.13 MB 139.04 MB +926.04 KB +0.7%
hits_032.vortex 1.0 vortex-compact 109.69 MB 110.41 MB +732.16 KB +0.7%
hits_058.vortex 1.0 vortex-compact 110.13 MB 110.80 MB +689.08 KB +0.6%
hits_096.vortex 1.0 vortex-file-compressed 199.13 MB 200.32 MB +1.19 MB +0.6%
hits_074.vortex 1.0 vortex-file-compressed 199.06 MB 200.22 MB +1.16 MB +0.6%
hits_045.vortex 1.0 vortex-file-compressed 139.20 MB 139.97 MB +785.32 KB +0.6%
hits_096.vortex 1.0 vortex-compact 152.39 MB 152.93 MB +559.24 KB +0.4%
hits_047.vortex 1.0 vortex-compact 109.53 MB 109.91 MB +391.69 KB +0.3%
hits_066.vortex 1.0 vortex-file-compressed 162.93 MB 163.50 MB +579.40 KB +0.3%
hits_093.vortex 1.0 vortex-compact 97.64 MB 97.96 MB +328.34 KB +0.3%
hits_054.vortex 1.0 vortex-compact 111.80 MB 112.15 MB +361.02 KB +0.3%
hits_050.vortex 1.0 vortex-compact 125.42 MB 125.82 MB +403.11 KB +0.3%
hits_068.vortex 1.0 vortex-compact 112.00 MB 112.28 MB +282.08 KB +0.2%
hits_052.vortex 1.0 vortex-compact 98.44 MB 98.67 MB +237.45 KB +0.2%
hits_074.vortex 1.0 vortex-compact 152.26 MB 152.61 MB +360.91 KB +0.2%
hits_021.vortex 1.0 vortex-compact 110.15 MB 110.38 MB +229.30 KB +0.2%
hits_007.vortex 1.0 vortex-file-compressed 201.31 MB 201.67 MB +372.73 KB +0.2%
hits_073.vortex 1.0 vortex-file-compressed 173.27 MB 173.54 MB +277.87 KB +0.2%
hits_053.vortex 1.0 vortex-file-compressed 189.58 MB 189.88 MB +300.76 KB +0.2%
hits_083.vortex 1.0 vortex-file-compressed 156.24 MB 156.47 MB +236.59 KB +0.1%
hits_093.vortex 1.0 vortex-file-compressed 130.94 MB 131.13 MB +197.93 KB +0.1%
hits_076.vortex 1.0 vortex-compact 125.25 MB 125.43 MB +182.77 KB +0.1%
hits_097.vortex 1.0 vortex-file-compressed 192.69 MB 192.91 MB +228.33 KB +0.1%
hits_044.vortex 1.0 vortex-compact 152.87 MB 153.03 MB +172.95 KB +0.1%
hits_011.vortex 1.0 vortex-file-compressed 200.12 MB 200.32 MB +211.42 KB +0.1%
hits_036.vortex 1.0 vortex-file-compressed 172.03 MB 172.21 MB +179.03 KB +0.1%
hits_034.vortex 1.0 vortex-compact 133.26 MB 133.39 MB +136.97 KB +0.1%
hits_013.vortex 1.0 vortex-file-compressed 161.83 MB 161.99 MB +164.01 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 160.31 MB 160.47 MB +161.37 KB +0.1%
hits_085.vortex 1.0 vortex-compact 152.64 MB 152.79 MB +152.38 KB +0.1%
hits_043.vortex 1.0 vortex-compact 94.32 MB 94.40 MB +88.49 KB +0.1%
hits_002.vortex 1.0 vortex-compact 123.93 MB 124.03 MB +110.52 KB +0.1%
hits_042.vortex 1.0 vortex-compact 136.62 MB 136.73 MB +119.41 KB +0.1%
hits_075.vortex 1.0 vortex-compact 137.78 MB 137.90 MB +116.00 KB +0.1%
hits_072.vortex 1.0 vortex-compact 75.58 MB 75.64 MB +63.41 KB +0.1%
hits_013.vortex 1.0 vortex-compact 125.71 MB 125.81 MB +103.04 KB +0.1%
hits_011.vortex 1.0 vortex-compact 152.12 MB 152.25 MB +124.05 KB +0.1%
hits_038.vortex 1.0 vortex-compact 138.23 MB 138.34 MB +112.61 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.30 MB 130.40 MB +104.44 KB +0.1%
hits_064.vortex 1.0 vortex-file-compressed 190.41 MB 190.56 MB +150.39 KB +0.1%
hits_056.vortex 1.0 vortex-compact 100.85 MB 100.92 MB +73.88 KB +0.1%
hits_007.vortex 1.0 vortex-compact 153.62 MB 153.72 MB +106.09 KB +0.1%
hits_015.vortex 1.0 vortex-compact 97.97 MB 98.04 MB +67.53 KB +0.1%
hits_049.vortex 1.0 vortex-compact 139.34 MB 139.44 MB +95.77 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.69 MB 130.77 MB +88.50 KB +0.1%
hits_019.vortex 1.0 vortex-file-compressed 140.01 MB 140.10 MB +90.64 KB +0.1%
hits_087.vortex 1.0 vortex-compact 125.26 MB 125.34 MB +80.34 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 201.03 MB 201.15 MB +121.38 KB +0.1%
hits_012.vortex 1.0 vortex-compact 138.85 MB 138.93 MB +77.68 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 154.01 MB 154.09 MB +81.65 KB +0.1%
hits_064.vortex 1.0 vortex-compact 138.85 MB 138.92 MB +71.55 KB +0.1%
hits_016.vortex 1.0 vortex-file-compressed 179.86 MB 179.95 MB +91.56 KB +0.0%
hits_058.vortex 1.0 vortex-file-compressed 154.40 MB 154.47 MB +73.95 KB +0.0%
hits_099.vortex 1.0 vortex-file-compressed 171.85 MB 171.92 MB +73.98 KB +0.0%
hits_050.vortex 1.0 vortex-file-compressed 161.62 MB 161.69 MB +67.05 KB +0.0%
hits_024.vortex 1.0 vortex-compact 124.61 MB 124.66 MB +51.66 KB +0.0%
hits_033.vortex 1.0 vortex-compact 153.11 MB 153.17 MB +60.68 KB +0.0%
hits_070.vortex 1.0 vortex-file-compressed 201.00 MB 201.07 MB +73.38 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 142.88 MB 142.93 MB +50.45 KB +0.0%
hits_004.vortex 1.0 vortex-file-compressed 130.65 MB 130.69 MB +44.62 KB +0.0%
hits_028.vortex 1.0 vortex-compact 115.62 MB 115.65 MB +37.66 KB +0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.70 MB 153.75 MB +48.82 KB +0.0%
hits_010.vortex 1.0 vortex-compact 122.49 MB 122.53 MB +38.32 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 161.38 MB 161.43 MB +49.23 KB +0.0%
hits_067.vortex 1.0 vortex-file-compressed 130.83 MB 130.87 MB +38.53 KB +0.0%
hits_012.vortex 1.0 vortex-file-compressed 190.48 MB 190.52 MB +49.33 KB +0.0%
hits_020.vortex 1.0 vortex-file-compressed 159.86 MB 159.90 MB +39.49 KB +0.0%
hits_079.vortex 1.0 vortex-compact 128.04 MB 128.07 MB +31.30 KB +0.0%
hits_057.vortex 1.0 vortex-compact 111.74 MB 111.77 MB +26.70 KB +0.0%
hits_053.vortex 1.0 vortex-compact 137.58 MB 137.62 MB +32.44 KB +0.0%
hits_055.vortex 1.0 vortex-compact 153.00 MB 153.04 MB +35.57 KB +0.0%
hits_071.vortex 1.0 vortex-compact 105.66 MB 105.68 MB +23.80 KB +0.0%
hits_063.vortex 1.0 vortex-compact 97.65 MB 97.67 MB +18.91 KB +0.0%
hits_009.vortex 1.0 vortex-file-compressed 101.07 MB 101.09 MB +19.00 KB +0.0%
hits_088.vortex 1.0 vortex-compact 133.86 MB 133.88 MB +23.77 KB +0.0%
hits_020.vortex 1.0 vortex-compact 111.73 MB 111.74 MB +18.96 KB +0.0%
hits_045.vortex 1.0 vortex-compact 105.70 MB 105.72 MB +17.45 KB +0.0%
hits_077.vortex 1.0 vortex-compact 134.05 MB 134.07 MB +21.13 KB +0.0%
hits_052.vortex 1.0 vortex-file-compressed 130.11 MB 130.13 MB +20.22 KB +0.0%
hits_018.vortex 1.0 vortex-compact 151.98 MB 152.00 MB +23.41 KB +0.0%
hits_084.vortex 1.0 vortex-compact 110.39 MB 110.41 MB +16.77 KB +0.0%
hits_003.vortex 1.0 vortex-compact 104.61 MB 104.63 MB +15.53 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 161.68 MB 161.70 MB +23.30 KB +0.0%
hits_062.vortex 1.0 vortex-file-compressed 171.33 MB 171.36 MB +21.45 KB +0.0%
hits_081.vortex 1.0 vortex-compact 153.42 MB 153.44 MB +16.35 KB +0.0%
hits_021.vortex 1.0 vortex-file-compressed 153.72 MB 153.73 MB +13.66 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 147.38 MB 147.39 MB +11.55 KB +0.0%
hits_086.vortex 1.0 vortex-file-compressed 191.78 MB 191.79 MB +14.91 KB +0.0%
hits_031.vortex 1.0 vortex-file-compressed 159.15 MB 159.15 MB +4.11 KB +0.0%
hits_083.vortex 1.0 vortex-compact 110.09 MB 110.09 MB +1.91 KB +0.0%
hits_047.vortex 1.0 vortex-file-compressed 153.83 MB 153.83 MB +368 B +0.0%
hits_063.vortex 1.0 vortex-file-compressed 130.83 MB 130.83 MB 584 B -0.0%
hits_082.vortex 1.0 vortex-compact 105.73 MB 105.73 MB 1.45 KB -0.0%
hits_098.vortex 1.0 vortex-file-compressed 137.89 MB 137.89 MB 4.62 KB -0.0%
hits_049.vortex 1.0 vortex-file-compressed 191.12 MB 191.11 MB 7.07 KB -0.0%
hits_054.vortex 1.0 vortex-file-compressed 147.34 MB 147.32 MB 12.20 KB -0.0%
hits_060.vortex 1.0 vortex-compact 140.10 MB 140.09 MB 11.70 KB -0.0%
hits_043.vortex 1.0 vortex-file-compressed 126.72 MB 126.71 MB 10.70 KB -0.0%
hits_042.vortex 1.0 vortex-file-compressed 202.21 MB 202.19 MB 17.53 KB -0.0%
hits_033.vortex 1.0 vortex-file-compressed 201.08 MB 201.06 MB 20.66 KB -0.0%
hits_092.vortex 1.0 vortex-file-compressed 200.75 MB 200.73 MB 22.45 KB -0.0%
hits_030.vortex 1.0 vortex-file-compressed 131.10 MB 131.09 MB 16.52 KB -0.0%
hits_000.vortex 1.0 vortex-file-compressed 130.69 MB 130.68 MB 16.87 KB -0.0%
hits_094.vortex 1.0 vortex-file-compressed 158.25 MB 158.23 MB 20.88 KB -0.0%
hits_010.vortex 1.0 vortex-file-compressed 169.11 MB 169.09 MB 23.08 KB -0.0%
hits_072.vortex 1.0 vortex-file-compressed 101.91 MB 101.90 MB 14.43 KB -0.0%
hits_075.vortex 1.0 vortex-file-compressed 189.08 MB 189.05 MB 29.10 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 126.63 MB 126.61 MB 21.37 KB -0.0%
hits_025.vortex 1.0 vortex-file-compressed 172.33 MB 172.30 MB 29.80 KB -0.0%
hits_080.vortex 1.0 vortex-file-compressed 127.04 MB 127.01 MB 22.92 KB -0.0%
hits_035.vortex 1.0 vortex-compact 75.97 MB 75.95 MB 17.98 KB -0.0%
hits_085.vortex 1.0 vortex-file-compressed 200.74 MB 200.69 MB 48.01 KB -0.0%
hits_034.vortex 1.0 vortex-file-compressed 181.75 MB 181.70 MB 45.38 KB -0.0%
hits_008.vortex 1.0 vortex-compact 105.76 MB 105.74 MB 26.66 KB -0.0%
hits_017.vortex 1.0 vortex-file-compressed 147.22 MB 147.19 MB 37.22 KB -0.0%
hits_008.vortex 1.0 vortex-file-compressed 139.47 MB 139.43 MB 36.85 KB -0.0%
hits_081.vortex 1.0 vortex-file-compressed 201.05 MB 200.99 MB 67.12 KB -0.0%
hits_098.vortex 1.0 vortex-compact 103.69 MB 103.66 MB 35.23 KB -0.0%
hits_006.vortex 1.0 vortex-compact 96.09 MB 96.06 MB 33.12 KB -0.0%
hits_078.vortex 1.0 vortex-file-compressed 130.34 MB 130.29 MB 45.05 KB -0.0%
hits_019.vortex 1.0 vortex-compact 106.15 MB 106.11 MB 38.42 KB -0.0%
hits_009.vortex 1.0 vortex-compact 75.24 MB 75.21 MB 27.89 KB -0.0%
hits_018.vortex 1.0 vortex-file-compressed 200.84 MB 200.76 MB 78.88 KB -0.0%
hits_002.vortex 1.0 vortex-file-compressed 161.61 MB 161.55 MB 65.91 KB -0.0%
hits_056.vortex 1.0 vortex-file-compressed 135.04 MB 134.98 MB 57.10 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 161.11 MB 161.04 MB 71.09 KB -0.0%
hits_090.vortex 1.0 vortex-file-compressed 192.42 MB 192.33 MB 89.08 KB -0.0%
hits_066.vortex 1.0 vortex-compact 117.23 MB 117.18 MB 55.10 KB -0.0%
hits_077.vortex 1.0 vortex-file-compressed 173.00 MB 172.92 MB 82.26 KB -0.0%
hits_017.vortex 1.0 vortex-compact 112.00 MB 111.94 MB 58.28 KB -0.1%
hits_037.vortex 1.0 vortex-file-compressed 178.13 MB 178.04 MB 92.81 KB -0.1%
hits_055.vortex 1.0 vortex-file-compressed 200.81 MB 200.71 MB 104.77 KB -0.1%
hits_001.vortex 1.0 vortex-compact 137.71 MB 137.64 MB 71.96 KB -0.1%
hits_023.vortex 1.0 vortex-compact 142.58 MB 142.50 MB 77.70 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.69 MB 100.63 MB 59.45 KB -0.1%
hits_057.vortex 1.0 vortex-file-compressed 159.93 MB 159.83 MB 98.26 KB -0.1%
hits_048.vortex 1.0 vortex-file-compressed 200.82 MB 200.69 MB 123.55 KB -0.1%
hits_062.vortex 1.0 vortex-compact 132.50 MB 132.42 MB 83.17 KB -0.1%
hits_073.vortex 1.0 vortex-compact 134.08 MB 133.99 MB 86.13 KB -0.1%
hits_099.vortex 1.0 vortex-compact 133.08 MB 132.99 MB 88.30 KB -0.1%
hits_051.vortex 1.0 vortex-compact 133.84 MB 133.75 MB 91.97 KB -0.1%
hits_088.vortex 1.0 vortex-file-compressed 172.69 MB 172.57 MB 118.97 KB -0.1%
hits_084.vortex 1.0 vortex-file-compressed 154.00 MB 153.90 MB 106.76 KB -0.1%
hits_097.vortex 1.0 vortex-compact 140.26 MB 140.15 MB 109.56 KB -0.1%
hits_092.vortex 1.0 vortex-compact 153.08 MB 152.97 MB 120.57 KB -0.1%
hits_005.vortex 1.0 vortex-file-compressed 167.45 MB 167.32 MB 141.36 KB -0.1%
hits_086.vortex 1.0 vortex-compact 139.71 MB 139.59 MB 127.52 KB -0.1%
hits_026.vortex 1.0 vortex-file-compressed 130.66 MB 130.55 MB 119.97 KB -0.1%
hits_040.vortex 1.0 vortex-compact 110.37 MB 110.27 MB 102.19 KB -0.1%
hits_003.vortex 1.0 vortex-file-compressed 136.59 MB 136.47 MB 127.21 KB -0.1%
hits_079.vortex 1.0 vortex-file-compressed 180.77 MB 180.60 MB 173.39 KB -0.1%
hits_014.vortex 1.0 vortex-compact 133.72 MB 133.57 MB 151.39 KB -0.1%
hits_059.vortex 1.0 vortex-compact 152.01 MB 151.84 MB 174.47 KB -0.1%
hits_046.vortex 1.0 vortex-compact 75.06 MB 74.97 MB 88.77 KB -0.1%
hits_051.vortex 1.0 vortex-file-compressed 173.13 MB 172.92 MB 210.38 KB -0.1%
hits_029.vortex 1.0 vortex-file-compressed 201.12 MB 200.87 MB 255.68 KB -0.1%
hits_025.vortex 1.0 vortex-compact 133.69 MB 133.52 MB 175.13 KB -0.1%
hits_022.vortex 1.0 vortex-compact 152.59 MB 152.39 MB 208.03 KB -0.1%
hits_089.vortex 1.0 vortex-compact 98.73 MB 98.59 MB 139.73 KB -0.1%
hits_070.vortex 1.0 vortex-compact 153.33 MB 153.12 MB 217.54 KB -0.1%
hits_028.vortex 1.0 vortex-file-compressed 152.35 MB 152.14 MB 219.53 KB -0.1%
hits_037.vortex 1.0 vortex-compact 132.23 MB 132.04 MB 198.83 KB -0.1%
hits_039.vortex 1.0 vortex-compact 124.31 MB 124.12 MB 199.16 KB -0.2%
hits_076.vortex 1.0 vortex-file-compressed 161.84 MB 161.59 MB 261.11 KB -0.2%
hits_035.vortex 1.0 vortex-file-compressed 102.30 MB 102.13 MB 168.15 KB -0.2%
hits_031.vortex 1.0 vortex-compact 111.49 MB 111.31 MB 186.56 KB -0.2%
hits_040.vortex 1.0 vortex-file-compressed 144.14 MB 143.89 MB 262.17 KB -0.2%
hits_095.vortex 1.0 vortex-compact 110.58 MB 110.38 MB 208.22 KB -0.2%
hits_005.vortex 1.0 vortex-compact 116.28 MB 116.06 MB 225.96 KB -0.2%
hits_029.vortex 1.0 vortex-compact 153.40 MB 153.09 MB 311.34 KB -0.2%
hits_015.vortex 1.0 vortex-file-compressed 130.56 MB 130.30 MB 265.02 KB -0.2%
hits_014.vortex 1.0 vortex-file-compressed 173.09 MB 172.71 MB 385.73 KB -0.2%
hits_036.vortex 1.0 vortex-compact 133.49 MB 133.18 MB 324.09 KB -0.2%
hits_090.vortex 1.0 vortex-compact 141.34 MB 141.01 MB 344.70 KB -0.2%
hits_048.vortex 1.0 vortex-compact 153.01 MB 152.62 MB 405.52 KB -0.3%
hits_094.vortex 1.0 vortex-compact 111.13 MB 110.80 MB 342.17 KB -0.3%
hits_069.vortex 1.0 vortex-compact 99.79 MB 99.48 MB 315.88 KB -0.3%
hits_030.vortex 1.0 vortex-compact 98.24 MB 97.92 MB 320.20 KB -0.3%
hits_082.vortex 1.0 vortex-file-compressed 139.71 MB 139.24 MB 480.23 KB -0.3%
hits_016.vortex 1.0 vortex-compact 127.38 MB 126.65 MB 748.72 KB -0.6%
hits_091.vortex 1.0 vortex-compact 112.09 MB 111.39 MB 712.66 KB -0.6%
hits_059.vortex 1.0 vortex-file-compressed 200.42 MB 199.14 MB 1.28 MB -0.6%
hits_022.vortex 1.0 vortex-file-compressed 200.26 MB 198.94 MB 1.32 MB -0.7%
hits_026.vortex 1.0 vortex-compact 97.92 MB 97.27 MB 660.65 KB -0.7%
hits_067.vortex 1.0 vortex-compact 99.21 MB 98.52 MB 713.84 KB -0.7%
hits_000.vortex 1.0 vortex-compact 98.11 MB 97.39 MB 739.02 KB -0.7%
hits_065.vortex 1.0 vortex-file-compressed 161.92 MB 160.70 MB 1.22 MB -0.8%
hits_071.vortex 1.0 vortex-file-compressed 140.40 MB 139.32 MB 1.08 MB -0.8%
hits_041.vortex 1.0 vortex-compact 97.92 MB 97.16 MB 781.82 KB -0.8%
hits_065.vortex 1.0 vortex-compact 125.50 MB 124.34 MB 1.16 MB -0.9%
hits_023.vortex 1.0 vortex-file-compressed 196.68 MB 194.85 MB 1.83 MB -0.9%
hits_060.vortex 1.0 vortex-file-compressed 194.74 MB 192.83 MB 1.91 MB -1.0%
hits_001.vortex 1.0 vortex-file-compressed 190.62 MB 188.71 MB 1.91 MB -1.0%
hits_038.vortex 1.0 vortex-file-compressed 191.97 MB 189.68 MB 2.28 MB -1.2%
hits_080.vortex 1.0 vortex-compact 96.80 MB 94.72 MB 2.08 MB -2.1%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 11.90 GB → 11.90 GB (-0.0%)
  • vortex-file-compressed: 15.97 GB → 15.96 GB (-0.0%)

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ab06f552 vs base e148f028
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+1.7%, environment too noisy confidence) · DuckDB No clear signal (-0.5%, environment too noisy confidence)
Vortex (geomean): hot 1.027x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.021x ➖ · cold 0.972x ➖
Shifts: Parquet (control) +2.1% · Median polish +5.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.052x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 44277740 / 80350298 / -44.9% 🟢 153834116 / 144225066 / +6.7% 0.29 / 0.56 / -48.3%
fineweb_q01/datafusion:vortex-file-compressed 556146668 / 442293284 / +25.7% 1049098119 / 760596947 / +37.9% 🔴 0.53 / 0.58 / -8.8%
fineweb_q02/datafusion:vortex-file-compressed 426814856 / 546641003 / -21.9% 504224455 / 678256401 / -25.7% 0.85 / 0.81 / +5.0%
fineweb_q03/datafusion:vortex-file-compressed 573121202 / 486074120 / +17.9% 785650913 / 712806230 / +10.2% 0.73 / 0.68 / +7.0%
fineweb_q04/datafusion:vortex-file-compressed 480966224 / 395152509 / +21.7% 524118074 / 515751554 / +1.6% 0.92 / 0.77 / +19.8%
fineweb_q05/datafusion:vortex-file-compressed 448708328 / 478109980 / -6.1% 442393820 / 466210790 / -5.1% 1.01 / 1.03 / -1.1%
fineweb_q06/datafusion:vortex-file-compressed 871658265 / 695316556 / +25.4% 818989443 / 754123873 / +8.6% 1.06 / 0.92 / +15.4%
fineweb_q07/datafusion:vortex-file-compressed 706109771 / 523876202 / +34.8% 🔴 610874206 / 471192105 / +29.6% 1.16 / 1.11 / +4.0%
fineweb_q08/datafusion:vortex-file-compressed 334262171 / 261063976 / +28.0% 335695506 / 278454345 / +20.6% 1.00 / 0.94 / +6.2%
datafusion / vortex-compact / ns (1.110x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact 64448703 / 57328756 / +12.4% 146749913 / 183781550 / -20.1% 0.44 / 0.31 / +40.8%
fineweb_q01/datafusion:vortex-compact 505051350 / 378140337 / +33.6% 🔴 647952592 / 643825361 / +0.6% 0.78 / 0.59 / +32.7%
fineweb_q02/datafusion:vortex-compact 402471781 / 352112878 / +14.3% 423057304 / 468191156 / -9.6% 0.95 / 0.75 / +26.5%
fineweb_q03/datafusion:vortex-compact 659676182 / 595904772 / +10.7% 782889584 / 804143418 / -2.6% 0.84 / 0.74 / +13.7%
fineweb_q04/datafusion:vortex-compact 491687216 / 461126165 / +6.6% 504169750 / 452891598 / +11.3% 0.98 / 1.02 / -4.2%
fineweb_q05/datafusion:vortex-compact 468835864 / 484757583 / -3.3% 455755963 / 509165092 / -10.5% 1.03 / 0.95 / +8.0%
fineweb_q06/datafusion:vortex-compact 700841734 / 651041340 / +7.6% 684250596 / 644849406 / +6.1% 1.02 / 1.01 / +1.5%
fineweb_q07/datafusion:vortex-compact 497201794 / 485530048 / +2.4% 450597873 / 446478542 / +0.9% 1.10 / 1.09 / +1.5%
fineweb_q08/datafusion:vortex-compact 195563906 / 165522471 / +18.1% 220035909 / 164677138 / +33.6% 🔴 0.89 / 1.01 / -11.6%
datafusion / parquet / ns (1.062x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 573595204 / 445909912 / +28.6% 900160127 / 794218586 / +13.3% 0.64 / 0.56 / +13.5%
fineweb_q01/datafusion:parquet 725963504 / 1652368132 / -56.1% 🟢 712838186 / 2951561979 / -75.8% 🟢 1.02 / 0.56 / +81.9%
fineweb_q02/datafusion:parquet 839179574 / 702511224 / +19.5% 801359397 / 819944230 / -2.3% 1.05 / 0.86 / +22.2%
fineweb_q03/datafusion:parquet 879066274 / 683988000 / +28.5% 1044593653 / 698893670 / +49.5% 🔴 0.84 / 0.98 / -14.0%
fineweb_q04/datafusion:parquet 900122444 / 696018778 / +29.3% 897767698 / 833847265 / +7.7% 1.00 / 0.83 / +20.1%
fineweb_q05/datafusion:parquet 820945304 / 819079021 / +0.2% 843328377 / 1027775235 / -17.9% 0.97 / 0.80 / +22.1%
fineweb_q06/datafusion:parquet 1044505606 / 727386186 / +43.6% 🔴 1122221991 / 668980121 / +67.8% 🔴 0.93 / 1.09 / -14.4%
fineweb_q07/datafusion:parquet 747328691 / 791601563 / -5.6% 742866277 / 658479477 / +12.8% 1.01 / 1.20 / -16.3%
fineweb_q08/datafusion:parquet 945646080 / 836112882 / +13.1% 824894838 / 792903847 / +4.0% 1.15 / 1.05 / +8.7%
duckdb / vortex-file-compressed / ns (1.025x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 57938792 / 63619468 / -8.9% 74632521 / 66365636 / +12.5% 0.78 / 0.96 / -19.0%
fineweb_q01/duckdb:vortex-file-compressed 440046508 / 387042192 / +13.7% 436657373 / 637950632 / -31.6% 🟢 1.01 / 0.61 / +66.1%
fineweb_q02/duckdb:vortex-file-compressed 570921252 / 568927349 / +0.4% 569704227 / 573327273 / -0.6% 1.00 / 0.99 / +1.0%
fineweb_q03/duckdb:vortex-file-compressed 1144081242 / 933263839 / +22.6% 1289629940 / 992849701 / +29.9% 0.89 / 0.94 / -5.6%
fineweb_q04/duckdb:vortex-file-compressed 945033599 / 941333753 / +0.4% 1022307322 / 1084788831 / -5.8% 0.92 / 0.87 / +6.5%
fineweb_q05/duckdb:vortex-file-compressed 921029758 / 872761978 / +5.5% 978997393 / 985103560 / -0.6% 0.94 / 0.89 / +6.2%
fineweb_q06/duckdb:vortex-file-compressed 1162199896 / 1133152704 / +2.6% 1310246225 / 1215476569 / +7.8% 0.89 / 0.93 / -4.9%
fineweb_q07/duckdb:vortex-file-compressed 1021906638 / 1084206328 / -5.7% 1118073055 / 1137164202 / -1.7% 0.91 / 0.95 / -4.1%
fineweb_q08/duckdb:vortex-file-compressed 394916544 / 411829590 / -4.1% 449626561 / 476341057 / -5.6% 0.88 / 0.86 / +1.6%
duckdb / vortex-compact / ns (0.930x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact 59991073 / 81617978 / -26.5% 67925282 / 88852369 / -23.6% 0.88 / 0.92 / -3.9%
fineweb_q01/duckdb:vortex-compact 401385642 / 450340616 / -10.9% 516714088 / 520179253 / -0.7% 0.78 / 0.87 / -10.3%
fineweb_q02/duckdb:vortex-compact 591359284 / 669199243 / -11.6% 574974072 / 579540580 / -0.8% 1.03 / 1.15 / -10.9%
fineweb_q03/duckdb:vortex-compact 1066698210 / 1206636361 / -11.6% 1252185321 / 1363256557 / -8.1% 0.85 / 0.89 / -3.8%
fineweb_q04/duckdb:vortex-compact 1086522638 / 1062798350 / +2.2% 1127273374 / 1063770661 / +6.0% 0.96 / 1.00 / -3.5%
fineweb_q05/duckdb:vortex-compact 893507989 / 978910676 / -8.7% 969300421 / 1147206839 / -15.5% 0.92 / 0.85 / +8.0%
fineweb_q06/duckdb:vortex-compact 1091602622 / 1125196328 / -3.0% 1121778375 / 1196686733 / -6.3% 0.97 / 0.94 / +3.5%
fineweb_q07/duckdb:vortex-compact 924557664 / 915625490 / +1.0% 1129461942 / 987050802 / +14.4% 0.82 / 0.93 / -11.8%
fineweb_q08/duckdb:vortex-compact 374028814 / 337239224 / +10.9% 400850725 / 436058592 / -8.1% 0.93 / 0.77 / +20.7%
duckdb / parquet / ns (0.982x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 303663864 / 413598612 / -26.6% 413202087 / 470762744 / -12.2% 0.73 / 0.88 / -16.4%
fineweb_q01/duckdb:parquet 551195685 / 534041018 / +3.2% 650011002 / 598921611 / +8.5% 0.85 / 0.89 / -4.9%
fineweb_q02/duckdb:parquet 576780768 / 541316902 / +6.6% 620942416 / 598174357 / +3.8% 0.93 / 0.90 / +2.6%
fineweb_q03/duckdb:parquet 1843923872 / 771168507 / +139.1% 🔴 936237282 / 863244661 / +8.5% 1.97 / 0.89 / +120.5%
fineweb_q04/duckdb:parquet 783818499 / 839103205 / -6.6% 808126763 / 790573654 / +2.2% 0.97 / 1.06 / -8.6%
fineweb_q05/duckdb:parquet 839532312 / 714128878 / +17.6% 1076685054 / 773908562 / +39.1% 🔴 0.78 / 0.92 / -15.5%
fineweb_q06/duckdb:parquet 790347160 / 713189998 / +10.8% 865516912 / 821236917 / +5.4% 0.91 / 0.87 / +5.1%
fineweb_q07/duckdb:parquet 753657100 / 824259702 / -8.6% 822783654 / 877561508 / -6.2% 0.92 / 0.94 / -2.5%
fineweb_q08/duckdb:parquet 317603066 / 806219401 / -60.6% 🟢 428093218 / 744834096 / -42.5% 🟢 0.74 / 1.08 / -31.5%

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ab06f552 vs base f3aef93b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.0%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+0.1%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.003x ➖
Parquet (geomean): hot 1.000x ➖ · cold 0.988x ➖
Shifts: Parquet (control) -0.0% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 90978047 / 90389702 / +0.7% 153773130 / 151856562 / +1.3% 0.59 / 0.60 / -0.6%
tpch_q02/datafusion:vortex-file-compressed 64823271 / 63867896 / +1.5% 96407172 / 95228950 / +1.2% 0.67 / 0.67 / +0.3%
tpch_q03/datafusion:vortex-file-compressed 63845764 / 64264698 / -0.7% 128141395 / 119118997 / +7.6% 0.50 / 0.54 / -7.6%
tpch_q04/datafusion:vortex-file-compressed 34144874 / 34029528 / +0.3% 70622502 / 71993377 / -1.9% 0.48 / 0.47 / +2.3%
tpch_q05/datafusion:vortex-file-compressed 119706667 / 120244071 / -0.4% 180516082 / 176416046 / +2.3% 0.66 / 0.68 / -2.7%
tpch_q06/datafusion:vortex-file-compressed 11285181 / 10984522 / +2.7% 60077469 / 56685732 / +6.0% 0.19 / 0.19 / -3.1%
tpch_q07/datafusion:vortex-file-compressed 134508773 / 135390837 / -0.7% 186335235 / 208172907 / -10.5% 🟢 0.72 / 0.65 / +11.0%
tpch_q08/datafusion:vortex-file-compressed 145427725 / 144599500 / +0.6% 223709141 / 215266294 / +3.9% 0.65 / 0.67 / -3.2%
tpch_q09/datafusion:vortex-file-compressed 184529923 / 185916013 / -0.7% 274067046 / 267662057 / +2.4% 0.67 / 0.69 / -3.1%
tpch_q10/datafusion:vortex-file-compressed 70653658 / 70508204 / +0.2% 141729095 / 135856164 / +4.3% 0.50 / 0.52 / -3.9%
tpch_q11/datafusion:vortex-file-compressed 42777800 / 43206196 / -1.0% 68257153 / 71113965 / -4.0% 0.63 / 0.61 / +3.2%
tpch_q12/datafusion:vortex-file-compressed 35055617 / 35634056 / -1.6% 79261262 / 85852443 / -7.7% 0.44 / 0.42 / +6.6%
tpch_q13/datafusion:vortex-file-compressed 48385596 / 48917315 / -1.1% 86224693 / 84239337 / +2.4% 0.56 / 0.58 / -3.4%
tpch_q14/datafusion:vortex-file-compressed 21509808 / 21513197 / -0.0% 85831122 / 86292354 / -0.5% 0.25 / 0.25 / +0.5%
tpch_q15/datafusion:vortex-file-compressed 34312944 / 33901530 / +1.2% 95162325 / 89817384 / +6.0% 0.36 / 0.38 / -4.5%
tpch_q16/datafusion:vortex-file-compressed 37317561 / 37265011 / +0.1% 63681357 / 68221919 / -6.7% 0.59 / 0.55 / +7.3%
tpch_q17/datafusion:vortex-file-compressed 178555728 / 175674065 / +1.6% 227097050 / 221839440 / +2.4% 0.79 / 0.79 / -0.7%
tpch_q18/datafusion:vortex-file-compressed 204252632 / 205309798 / -0.5% 274105322 / 274827475 / -0.3% 0.75 / 0.75 / -0.3%
tpch_q19/datafusion:vortex-file-compressed 30825635 / 29807452 / +3.4% 87408394 / 87625603 / -0.2% 0.35 / 0.34 / +3.7%
tpch_q20/datafusion:vortex-file-compressed 60607440 / 60960778 / -0.6% 123419816 / 119930117 / +2.9% 0.49 / 0.51 / -3.4%
tpch_q21/datafusion:vortex-file-compressed 178029236 / 181912454 / -2.1% 241462467 / 239010326 / +1.0% 0.74 / 0.76 / -3.1%
tpch_q22/datafusion:vortex-file-compressed 25230888 / 25050594 / +0.7% 51306249 / 54896058 / -6.5% 0.49 / 0.46 / +7.8%
datafusion / vortex-compact / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 98696761 / 97956316 / +0.8% 150220675 / 149170766 / +0.7% 0.66 / 0.66 / +0.1%
tpch_q02/datafusion:vortex-compact 66437308 / 64984514 / +2.2% 92118628 / 95948029 / -4.0% 0.72 / 0.68 / +6.5%
tpch_q03/datafusion:vortex-compact 68419235 / 67255013 / +1.7% 116261133 / 120255892 / -3.3% 0.59 / 0.56 / +5.2%
tpch_q04/datafusion:vortex-compact 37959379 / 38288655 / -0.9% 68623909 / 64528224 / +6.3% 0.55 / 0.59 / -6.8%
tpch_q05/datafusion:vortex-compact 120547212 / 120064641 / +0.4% 173415864 / 169608562 / +2.2% 0.70 / 0.71 / -1.8%
tpch_q06/datafusion:vortex-compact 15473038 / 15689478 / -1.4% 51272926 / 51234301 / +0.1% 0.30 / 0.31 / -1.5%
tpch_q07/datafusion:vortex-compact 141059070 / 142146466 / -0.8% 193503061 / 208700090 / -7.3% 0.73 / 0.68 / +7.0%
tpch_q08/datafusion:vortex-compact 144800991 / 145615687 / -0.6% 214947840 / 207922213 / +3.4% 0.67 / 0.70 / -3.8%
tpch_q09/datafusion:vortex-compact 186033866 / 187175828 / -0.6% 349464938 / 262184809 / +33.3% 🔴 0.53 / 0.71 / -25.4%
tpch_q10/datafusion:vortex-compact 80552799 / 78704963 / +2.3% 131185004 / 126745302 / +3.5% 0.61 / 0.62 / -1.1%
tpch_q11/datafusion:vortex-compact 43947592 / 44479345 / -1.2% 69307013 / 70112155 / -1.1% 0.63 / 0.63 / -0.0%
tpch_q12/datafusion:vortex-compact 46551554 / 47705476 / -2.4% 77965849 / 77556898 / +0.5% 0.60 / 0.62 / -2.9%
tpch_q13/datafusion:vortex-compact 58015271 / 57220019 / +1.4% 91927732 / 89269299 / +3.0% 0.63 / 0.64 / -1.5%
tpch_q14/datafusion:vortex-compact 25169466 / 27642485 / -8.9% 86122852 / 86774298 / -0.8% 0.29 / 0.32 / -8.3%
tpch_q15/datafusion:vortex-compact 47951907 / 47303109 / +1.4% 99437312 / 100939894 / -1.5% 0.48 / 0.47 / +2.9%
tpch_q16/datafusion:vortex-compact 40304164 / 38848344 / +3.7% 66937377 / 68457758 / -2.2% 0.60 / 0.57 / +6.1%
tpch_q17/datafusion:vortex-compact 173920967 / 178406153 / -2.5% 217262649 / 223282816 / -2.7% 0.80 / 0.80 / +0.2%
tpch_q18/datafusion:vortex-compact 207581623 / 205194111 / +1.2% 259777472 / 269481736 / -3.6% 0.80 / 0.76 / +4.9%
tpch_q19/datafusion:vortex-compact 36618858 / 36913688 / -0.8% 82726412 / 83542640 / -1.0% 0.44 / 0.44 / +0.2%
tpch_q20/datafusion:vortex-compact 65564085 / 66213630 / -1.0% 115892793 / 115028640 / +0.8% 0.57 / 0.58 / -1.7%
tpch_q21/datafusion:vortex-compact 186243543 / 188428566 / -1.2% 244951704 / 239352381 / +2.3% 0.76 / 0.79 / -3.4%
tpch_q22/datafusion:vortex-compact 26678646 / 26277432 / +1.5% 54209519 / 54164802 / +0.1% 0.49 / 0.49 / +1.4%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87657208 / 88305805 / -0.7% 125040995 / 132087013 / -5.3% 0.70 / 0.67 / +4.9%
tpch_q02/datafusion:parquet 175863589 / 175673415 / +0.1% 199988077 / 200441206 / -0.2% 0.88 / 0.88 / +0.3%
tpch_q03/datafusion:parquet 138186194 / 137416027 / +0.6% 186074846 / 182705258 / +1.8% 0.74 / 0.75 / -1.3%
tpch_q04/datafusion:parquet 59226902 / 58735650 / +0.8% 92197065 / 103801588 / -11.2% 🟢 0.64 / 0.57 / +13.5%
tpch_q05/datafusion:parquet 169823879 / 170020426 / -0.1% 223257448 / 228175964 / -2.2% 0.76 / 0.75 / +2.1%
tpch_q06/datafusion:parquet 37022311 / 37054418 / -0.1% 75396761 / 79955670 / -5.7% 0.49 / 0.46 / +6.0%
tpch_q07/datafusion:parquet 218530963 / 218527175 / +0.0% 277218106 / 275544605 / +0.6% 0.79 / 0.79 / -0.6%
tpch_q08/datafusion:parquet 221509522 / 221502880 / +0.0% 286470026 / 297389877 / -3.7% 0.77 / 0.74 / +3.8%
tpch_q09/datafusion:parquet 314334744 / 314640480 / -0.1% 377511345 / 382940077 / -1.4% 0.83 / 0.82 / +1.3%
tpch_q10/datafusion:parquet 321486874 / 321041712 / +0.1% 381101973 / 387826017 / -1.7% 0.84 / 0.83 / +1.9%
tpch_q11/datafusion:parquet 126648747 / 126316083 / +0.3% 149826574 / 150879244 / -0.7% 0.85 / 0.84 / +1.0%
tpch_q12/datafusion:parquet 83963243 / 84459035 / -0.6% 121051012 / 124770714 / -3.0% 0.69 / 0.68 / +2.5%
tpch_q13/datafusion:parquet 216524571 / 216638619 / -0.1% 249677817 / 250642733 / -0.4% 0.87 / 0.86 / +0.3%
tpch_q14/datafusion:parquet 88142607 / 87712490 / +0.5% 184416188 / 192459473 / -4.2% 0.48 / 0.46 / +4.9%
tpch_q15/datafusion:parquet 108386130 / 105003007 / +3.2% 153500263 / 161638845 / -5.0% 0.71 / 0.65 / +8.7%
tpch_q16/datafusion:parquet 97160017 / 98431904 / -1.3% 120848411 / 124309133 / -2.8% 0.80 / 0.79 / +1.5%
tpch_q17/datafusion:parquet 212594881 / 214308756 / -0.8% 261792632 / 256914789 / +1.9% 0.81 / 0.83 / -2.6%
tpch_q18/datafusion:parquet 272501139 / 270733328 / +0.7% 316453372 / 315751320 / +0.2% 0.86 / 0.86 / +0.4%
tpch_q19/datafusion:parquet 109427055 / 108846116 / +0.5% 164573629 / 166498922 / -1.2% 0.66 / 0.65 / +1.7%
tpch_q20/datafusion:parquet 188873279 / 188958286 / -0.0% 246739066 / 249568120 / -1.1% 0.77 / 0.76 / +1.1%
tpch_q21/datafusion:parquet 247734549 / 248875223 / -0.5% 307852995 / 313964847 / -1.9% 0.80 / 0.79 / +1.5%
tpch_q22/datafusion:parquet 153727518 / 153263683 / +0.3% 176255004 / 179083385 / -1.6% 0.87 / 0.86 / +1.9%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 33758231 / 32837977 / +2.8% 66912951 / 67372935 / -0.7% 0.50 / 0.49 / +3.5%
tpch_q02/duckdb:vortex-file-compressed 31896354 / 31708803 / +0.6% 45306816 / 46388577 / -2.3% 0.70 / 0.68 / +3.0%
tpch_q03/duckdb:vortex-file-compressed 53624115 / 53355188 / +0.5% 104036508 / 101296265 / +2.7% 0.52 / 0.53 / -2.1%
tpch_q04/duckdb:vortex-file-compressed 51339479 / 50962950 / +0.7% 88660083 / 87976118 / +0.8% 0.58 / 0.58 / -0.0%
tpch_q05/duckdb:vortex-file-compressed 68848184 / 69346039 / -0.7% 106544475 / 108146033 / -1.5% 0.65 / 0.64 / +0.8%
tpch_q06/duckdb:vortex-file-compressed 15120678 / 14746081 / +2.5% 53130347 / 51587100 / +3.0% 0.28 / 0.29 / -0.4%
tpch_q07/duckdb:vortex-file-compressed 55207724 / 55139484 / +0.1% 109905520 / 108310223 / +1.5% 0.50 / 0.51 / -1.3%
tpch_q08/duckdb:vortex-file-compressed 87706917 / 88106741 / -0.5% 134871167 / 130697407 / +3.2% 0.65 / 0.67 / -3.5%
tpch_q09/duckdb:vortex-file-compressed 97080088 / 97694449 / -0.6% 150498736 / 155108948 / -3.0% 0.65 / 0.63 / +2.4%
tpch_q10/duckdb:vortex-file-compressed 88291362 / 87760736 / +0.6% 146471072 / 143798365 / +1.9% 0.60 / 0.61 / -1.2%
tpch_q11/duckdb:vortex-file-compressed 13264157 / 14143149 / -6.2% 27848610 / 27584292 / +1.0% 0.48 / 0.51 / -7.1%
tpch_q12/duckdb:vortex-file-compressed 44769984 / 43375589 / +3.2% 83159746 / 83662236 / -0.6% 0.54 / 0.52 / +3.8%
tpch_q13/duckdb:vortex-file-compressed 66616210 / 67833267 / -1.8% 88711302 / 87170476 / +1.8% 0.75 / 0.78 / -3.5%
tpch_q14/duckdb:vortex-file-compressed 28188451 / 28145058 / +0.2% 69799514 / 72062033 / -3.1% 0.40 / 0.39 / +3.4%
tpch_q15/duckdb:vortex-file-compressed 24946703 / 24787588 / +0.6% 63191494 / 63664366 / -0.7% 0.39 / 0.39 / +1.4%
tpch_q16/duckdb:vortex-file-compressed 49762142 / 50185160 / -0.8% 59559536 / 59835097 / -0.5% 0.84 / 0.84 / -0.4%
tpch_q17/duckdb:vortex-file-compressed 34148034 / 35158826 / -2.9% 66837593 / 66222394 / +0.9% 0.51 / 0.53 / -3.8%
tpch_q18/duckdb:vortex-file-compressed 98294442 / 101603239 / -3.3% 123720778 / 120712133 / +2.5% 0.79 / 0.84 / -5.6%
tpch_q19/duckdb:vortex-file-compressed 26173232 / 25258568 / +3.6% 75373638 / 73019531 / +3.2% 0.35 / 0.35 / +0.4%
tpch_q20/duckdb:vortex-file-compressed 39637296 / 39474955 / +0.4% 92546290 / 89780305 / +3.1% 0.43 / 0.44 / -2.6%
tpch_q21/duckdb:vortex-file-compressed 95671778 / 94075928 / +1.7% 146515985 / 145411297 / +0.8% 0.65 / 0.65 / +0.9%
tpch_q22/duckdb:vortex-file-compressed 34719604 / 34785622 / -0.2% 52499123 / 51979383 / +1.0% 0.66 / 0.67 / -1.2%
duckdb / vortex-compact / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 46991314 / 46308088 / +1.5% 78923606 / 76275547 / +3.5% 0.60 / 0.61 / -1.9%
tpch_q02/duckdb:vortex-compact 41601500 / 41145031 / +1.1% 58193412 / 56894913 / +2.3% 0.71 / 0.72 / -1.1%
tpch_q03/duckdb:vortex-compact 57708784 / 57903633 / -0.3% 95951153 / 98428920 / -2.5% 0.60 / 0.59 / +2.2%
tpch_q04/duckdb:vortex-compact 53749039 / 54166421 / -0.8% 78481342 / 78987061 / -0.6% 0.68 / 0.69 / -0.1%
tpch_q05/duckdb:vortex-compact 71415683 / 70646821 / +1.1% 100886265 / 103905620 / -2.9% 0.71 / 0.68 / +4.1%
tpch_q06/duckdb:vortex-compact 19782004 / 19208902 / +3.0% 50806393 / 50735538 / +0.1% 0.39 / 0.38 / +2.8%
tpch_q07/duckdb:vortex-compact 63096100 / 61866500 / +2.0% 104064693 / 106750767 / -2.5% 0.61 / 0.58 / +4.6%
tpch_q08/duckdb:vortex-compact 90847857 / 90690735 / +0.2% 129432241 / 124665124 / +3.8% 0.70 / 0.73 / -3.5%
tpch_q09/duckdb:vortex-compact 106182547 / 104856830 / +1.3% 151355426 / 154349521 / -1.9% 0.70 / 0.68 / +3.3%
tpch_q10/duckdb:vortex-compact 104939152 / 103363815 / +1.5% 143010535 / 140083974 / +2.1% 0.73 / 0.74 / -0.6%
tpch_q11/duckdb:vortex-compact 13999737 / 13719613 / +2.0% 26002486 / 26808493 / -3.0% 0.54 / 0.51 / +5.2%
tpch_q12/duckdb:vortex-compact 58839373 / 58316078 / +0.9% 80264557 / 79909060 / +0.4% 0.73 / 0.73 / +0.5%
tpch_q13/duckdb:vortex-compact 77094877 / 77077154 / +0.0% 92514598 / 97397742 / -5.0% 0.83 / 0.79 / +5.3%
tpch_q14/duckdb:vortex-compact 33435590 / 32853726 / +1.8% 70240570 / 70855622 / -0.9% 0.48 / 0.46 / +2.7%
tpch_q15/duckdb:vortex-compact 31079474 / 30878477 / +0.7% 67524197 / 69235307 / -2.5% 0.46 / 0.45 / +3.2%
tpch_q16/duckdb:vortex-compact 53755951 / 54528871 / -1.4% 63445292 / 65022546 / -2.4% 0.85 / 0.84 / +1.0%
tpch_q17/duckdb:vortex-compact 36320956 / 37657196 / -3.5% 63525101 / 65731965 / -3.4% 0.57 / 0.57 / -0.2%
tpch_q18/duckdb:vortex-compact 100944323 / 95795478 / +5.4% 116136897 / 116721989 / -0.5% 0.87 / 0.82 / +5.9%
tpch_q19/duckdb:vortex-compact 33735729 / 32988962 / +2.3% 73674360 / 75520524 / -2.4% 0.46 / 0.44 / +4.8%
tpch_q20/duckdb:vortex-compact 48880817 / 48535504 / +0.7% 95204032 / 93305898 / +2.0% 0.51 / 0.52 / -1.3%
tpch_q21/duckdb:vortex-compact 107992839 / 106937092 / +1.0% 146163665 / 145938428 / +0.2% 0.74 / 0.73 / +0.8%
tpch_q22/duckdb:vortex-compact 39525586 / 39278959 / +0.6% 57349780 / 55391849 / +3.5% 0.69 / 0.71 / -2.8%
duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68125223 / 69187491 / -1.5% 90216039 / 90806246 / -0.6% 0.76 / 0.76 / -0.9%
tpch_q02/duckdb:parquet 87815399 / 87875518 / -0.1% 99130333 / 99065574 / +0.1% 0.89 / 0.89 / -0.1%
tpch_q03/duckdb:parquet 111793456 / 112593012 / -0.7% 141687601 / 145656701 / -2.7% 0.79 / 0.77 / +2.1%
tpch_q04/duckdb:parquet 77611008 / 78132763 / -0.7% 99119608 / 100408063 / -1.3% 0.78 / 0.78 / +0.6%
tpch_q05/duckdb:parquet 125097384 / 124121970 / +0.8% 155222603 / 154580052 / +0.4% 0.81 / 0.80 / +0.4%
tpch_q06/duckdb:parquet 35709208 / 36345087 / -1.7% 58862588 / 61108974 / -3.7% 0.61 / 0.59 / +2.0%
tpch_q07/duckdb:parquet 117586070 / 117724105 / -0.1% 157538294 / 154169385 / +2.2% 0.75 / 0.76 / -2.3%
tpch_q08/duckdb:parquet 148400484 / 148503374 / -0.1% 190750318 / 192069915 / -0.7% 0.78 / 0.77 / +0.6%
tpch_q09/duckdb:parquet 236790445 / 238068353 / -0.5% 282534315 / 282628292 / -0.0% 0.84 / 0.84 / -0.5%
tpch_q10/duckdb:parquet 317885554 / 316464040 / +0.4% 339264565 / 342379494 / -0.9% 0.94 / 0.92 / +1.4%
tpch_q11/duckdb:parquet 44058445 / 43887318 / +0.4% 51876187 / 51577936 / +0.6% 0.85 / 0.85 / -0.2%
tpch_q12/duckdb:parquet 72427902 / 72455984 / -0.0% 92237209 / 93970404 / -1.8% 0.79 / 0.77 / +1.8%
tpch_q13/duckdb:parquet 292693025 / 294201659 / -0.5% 308302563 / 311489212 / -1.0% 0.95 / 0.94 / +0.5%
tpch_q14/duckdb:parquet 101988332 / 102353158 / -0.4% 139838270 / 137991108 / +1.3% 0.73 / 0.74 / -1.7%
tpch_q15/duckdb:parquet 57321608 / 58105420 / -1.3% 87173681 / 87712355 / -0.6% 0.66 / 0.66 / -0.7%
tpch_q16/duckdb:parquet 101389856 / 101865045 / -0.5% 109369250 / 108848860 / +0.5% 0.93 / 0.94 / -0.9%
tpch_q17/duckdb:parquet 84011325 / 82896588 / +1.3% 112956025 / 112803651 / +0.1% 0.74 / 0.73 / +1.2%
tpch_q18/duckdb:parquet 158154223 / 157411810 / +0.5% 175972527 / 173115216 / +1.7% 0.90 / 0.91 / -1.2%
tpch_q19/duckdb:parquet 100088521 / 98025269 / +2.1% 138351441 / 135489313 / +2.1% 0.72 / 0.72 / -0.0%
tpch_q20/duckdb:parquet 147563007 / 148384320 / -0.6% 185503400 / 186359794 / -0.5% 0.80 / 0.80 / -0.1%
tpch_q21/duckdb:parquet 257323670 / 255095724 / +0.9% 279240887 / 273139298 / +2.2% 0.92 / 0.93 / -1.3%
tpch_q22/duckdb:parquet 168957253 / 169762350 / -0.5% 185155487 / 184624829 / +0.3% 0.91 / 0.92 / -0.8%
duckdb / duckdb / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:duckdb 24310912 / 24171688 / +0.6% 55841955 / 55024811 / +1.5% 0.44 / 0.44 / -0.9%
tpch_q02/duckdb:duckdb 21272784 / 21437473 / -0.8% 33616658 / 33916755 / -0.9% 0.63 / 0.63 / +0.1%
tpch_q03/duckdb:duckdb 45401692 / 45999598 / -1.3% 81602008 / 81894992 / -0.4% 0.56 / 0.56 / -0.9%
tpch_q04/duckdb:duckdb 56168194 / 55908352 / +0.5% 82409896 / 81866290 / +0.7% 0.68 / 0.68 / -0.2%
tpch_q05/duckdb:duckdb 59552681 / 60379124 / -1.4% 97147921 / 95505749 / +1.7% 0.61 / 0.63 / -3.0%
tpch_q06/duckdb:duckdb 14680961 / 15111307 / -2.8% 47989824 / 49852920 / -3.7% 0.31 / 0.30 / +0.9%
tpch_q07/duckdb:duckdb 43393070 / 44315972 / -2.1% 86160243 / 87310173 / -1.3% 0.50 / 0.51 / -0.8%
tpch_q08/duckdb:duckdb 66296002 / 67532374 / -1.8% 114537385 / 109845602 / +4.3% 0.58 / 0.61 / -5.9%
tpch_q09/duckdb:duckdb 77010620 / 77746667 / -0.9% 121952520 / 116197147 / +5.0% 0.63 / 0.67 / -5.6%
tpch_q10/duckdb:duckdb 91473917 / 93113906 / -1.8% 123307007 / 126098813 / -2.2% 0.74 / 0.74 / +0.5%
tpch_q11/duckdb:duckdb 10047018 / 10042247 / +0.0% 17959664 / 18095295 / -0.7% 0.56 / 0.55 / +0.8%
tpch_q12/duckdb:duckdb 40295972 / 40367601 / -0.2% 72594042 / 71543492 / +1.5% 0.56 / 0.56 / -1.6%
tpch_q13/duckdb:duckdb 101371652 / 103050114 / -1.6% 115355395 / 115229055 / +0.1% 0.88 / 0.89 / -1.7%
tpch_q14/duckdb:duckdb 32714211 / 32869302 / -0.5% 71325991 / 71185353 / +0.2% 0.46 / 0.46 / -0.7%
tpch_q15/duckdb:duckdb 25055057 / 26150079 / -4.2% 58890787 / 59477005 / -1.0% 0.43 / 0.44 / -3.2%
tpch_q16/duckdb:duckdb 44599062 / 45288180 / -1.5% 52082261 / 51376401 / +1.4% 0.86 / 0.88 / -2.9%
tpch_q17/duckdb:duckdb 26707111 / 26867445 / -0.6% 62576007 / 61044268 / +2.5% 0.43 / 0.44 / -3.0%
tpch_q18/duckdb:duckdb 72095444 / 72264828 / -0.2% 94677899 / 95218734 / -0.6% 0.76 / 0.76 / +0.3%
tpch_q19/duckdb:duckdb 29751436 / 30054633 / -1.0% 73859134 / 72082047 / +2.5% 0.40 / 0.42 / -3.4%
tpch_q20/duckdb:duckdb 38038044 / 38459255 / -1.1% 84380913 / 84428199 / -0.1% 0.45 / 0.46 / -1.0%
tpch_q21/duckdb:duckdb 64587126 / 64910799 / -0.5% 97797362 / 96567039 / +1.3% 0.66 / 0.67 / -1.8%
tpch_q22/duckdb:duckdb 35530739 / 35350530 / +0.5% 47574690 / 47642048 / -0.1% 0.75 / 0.74 / +0.7%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: Appian on NVME 📖

Commits: PR ab06f552 vs base 85466bb6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Engines: DataFusion No clear signal (+0.2%, low confidence) · DuckDB No clear signal (+0.2%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 0.990x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-file-compressed 51503565 / 52715173 / -2.3% 76681920 / 74574066 / +2.8% 0.67 / 0.71 / -5.0%
appian_q02/datafusion:vortex-file-compressed 226706567 / 225469286 / +0.5% 266998320 / 270390780 / -1.3% 0.85 / 0.83 / +1.8%
appian_q03/datafusion:vortex-file-compressed 141916025 / 140364506 / +1.1% 187059918 / 193465011 / -3.3% 0.76 / 0.73 / +4.6%
appian_q04/datafusion:vortex-file-compressed 9632436495 / 9603576565 / +0.3% 9742889859 / 9652403390 / +0.9% 0.99 / 0.99 / -0.6%
appian_q05/datafusion:vortex-file-compressed 135851203 / 134467760 / +1.0% 171992681 / 172967117 / -0.6% 0.79 / 0.78 / +1.6%
appian_q06/datafusion:vortex-file-compressed 140228693 / 140655546 / -0.3% 164826403 / 167700853 / -1.7% 0.85 / 0.84 / +1.4%
appian_q07/datafusion:vortex-file-compressed 157412980 / 155806964 / +1.0% 191246031 / 191388348 / -0.1% 0.82 / 0.81 / +1.1%
appian_q08/datafusion:vortex-file-compressed 526382012 / 523370036 / +0.6% 584687442 / 588428231 / -0.6% 0.90 / 0.89 / +1.2%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet 73669403 / 72657053 / +1.4% 93516630 / 90346817 / +3.5% 0.79 / 0.80 / -2.0%
appian_q02/datafusion:parquet 292250121 / 292787913 / -0.2% 327862051 / 335464907 / -2.3% 0.89 / 0.87 / +2.1%
appian_q03/datafusion:parquet 184586269 / 185668917 / -0.6% 229326404 / 230370804 / -0.5% 0.80 / 0.81 / -0.1%
appian_q04/datafusion:parquet 9677843562 / 9663636672 / +0.1% 9703715791 / 9756591374 / -0.5% 1.00 / 0.99 / +0.7%
appian_q05/datafusion:parquet 195267391 / 195021392 / +0.1% 220425553 / 221842732 / -0.6% 0.89 / 0.88 / +0.8%
appian_q06/datafusion:parquet 166554578 / 168023213 / -0.9% 186908721 / 189914323 / -1.6% 0.89 / 0.88 / +0.7%
appian_q07/datafusion:parquet 207537629 / 206027651 / +0.7% 243291163 / 243009078 / +0.1% 0.85 / 0.85 / +0.6%
appian_q08/datafusion:parquet 628973598 / 631943422 / -0.5% 690340667 / 689208569 / +0.2% 0.91 / 0.92 / -0.6%
duckdb / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-file-compressed 84029818 / 85378607 / -1.6% 100047816 / 101932155 / -1.8% 0.84 / 0.84 / +0.3%
appian_q02/duckdb:vortex-file-compressed 242868797 / 242362939 / +0.2% 259978909 / 263540570 / -1.4% 0.93 / 0.92 / +1.6%
appian_q03/duckdb:vortex-file-compressed 112515771 / 112768732 / -0.2% 132679639 / 134425475 / -1.3% 0.85 / 0.84 / +1.1%
appian_q04/duckdb:vortex-file-compressed 612569044 / 625273133 / -2.0% 640141240 / 620287096 / +3.2% 0.96 / 1.01 / -5.1%
appian_q05/duckdb:vortex-file-compressed 116616262 / 118567772 / -1.6% 130176791 / 132666155 / -1.9% 0.90 / 0.89 / +0.2%
appian_q06/duckdb:vortex-file-compressed 198604809 / 204992094 / -3.1% 207170510 / 222517998 / -6.9% 0.96 / 0.92 / +4.1%
appian_q07/duckdb:vortex-file-compressed 118607998 / 118931572 / -0.3% 132375726 / 134283920 / -1.4% 0.90 / 0.89 / +1.2%
appian_q08/duckdb:vortex-file-compressed 343086639 / 342170003 / +0.3% 358803990 / 362771303 / -1.1% 0.96 / 0.94 / +1.4%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet 95786664 / 94760393 / +1.1% 98917871 / 105289286 / -6.1% 0.97 / 0.90 / +7.6%
appian_q02/duckdb:parquet 243460506 / 239983841 / +1.4% 250599432 / 255747605 / -2.0% 0.97 / 0.94 / +3.5%
appian_q03/duckdb:parquet 133425774 / 132186416 / +0.9% 142270533 / 139202866 / +2.2% 0.94 / 0.95 / -1.2%
appian_q04/duckdb:parquet 490856981 / 489031470 / +0.4% 489397055 / 487359843 / +0.4% 1.00 / 1.00 / -0.0%
appian_q05/duckdb:parquet 132046561 / 132386998 / -0.3% 137504171 / 136692679 / +0.6% 0.96 / 0.97 / -0.8%
appian_q06/duckdb:parquet 115318537 / 117079923 / -1.5% 120300891 / 120436395 / -0.1% 0.96 / 0.97 / -1.4%
appian_q07/duckdb:parquet 107562932 / 110341410 / -2.5% 121571578 / 123309662 / -1.4% 0.88 / 0.89 / -1.1%
appian_q08/duckdb:parquet 361722914 / 369607043 / -2.1% 358513797 / 364070249 / -1.5% 1.01 / 1.02 / -0.6%
duckdb / duckdb / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
appian_q01/duckdb:duckdb 78987486 / 80136045 / -1.4% 91999260 / 91430606 / +0.6% 0.86 / 0.88 / -2.0%
appian_q02/duckdb:duckdb 220990916 / 212761247 / +3.9% 229667933 / 218773837 / +5.0% 0.96 / 0.97 / -1.1%
appian_q03/duckdb:duckdb 86233909 / 84626191 / +1.9% 93296117 / 94779498 / -1.6% 0.92 / 0.89 / +3.5%
appian_q04/duckdb:duckdb 544372671 / 543604342 / +0.1% 543660968 / 558889718 / -2.7% 1.00 / 0.97 / +2.9%
appian_q05/duckdb:duckdb 110283298 / 107878198 / +2.2% 119878264 / 121137215 / -1.0% 0.92 / 0.89 / +3.3%
appian_q06/duckdb:duckdb 187121230 / 185274548 / +1.0% 194942448 / 203446130 / -4.2% 0.96 / 0.91 / +5.4%
appian_q07/duckdb:duckdb 87819047 / 87965156 / -0.2% 100308439 / 101214809 / -0.9% 0.88 / 0.87 / +0.7%
appian_q08/duckdb:duckdb 306817713 / 311627253 / -1.5% 340975926 / 336895583 / +1.2% 0.90 / 0.92 / -2.7%
File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 271.81 MB → 271.55 MB (-0.1%)
  • vortex-file-compressed: 517.79 MB → 517.79 MB (0.0%)

@robert3005
robert3005 force-pushed the rk/optimize-with-session branch from be3d4e4 to 0e66881 Compare October 26, 2026 11:25
@github-actions

github-actions Bot commented Oct 26, 2026 •
edited
Loading

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on S3 📖

Commits: PR ab06f552 vs base 85466bb6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.6%
Engines: DataFusion No clear signal (+0.2%, environment too noisy confidence) · DuckDB No clear signal (-5.3%, environment too noisy confidence)
Vortex (geomean): hot 0.947x ➖ · cold 0.957x ➖
Parquet (geomean): hot 0.972x ➖ · cold 0.943x ➖
Shifts: Parquet (control) -2.8% · Median polish -1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.
datafusion / vortex-file-compressed / ns (0.952x ➖, 2↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 337809728 / 334394160 / +1.0% 1063438589 / 1096283803 / -3.0% 0.32 / 0.31 / +4.1%
tpch_q02/datafusion:vortex-file-compressed 514832805 / 593417945 / -13.2% 1009983269 / 1198289781 / -15.7% 0.51 / 0.50 / +2.9%
tpch_q03/datafusion:vortex-file-compressed 601567689 / 533134510 / +12.8% 1344413663 / 1462376049 / -8.1% 0.45 / 0.36 / +22.7%
tpch_q04/datafusion:vortex-file-compressed 424130654 / 659584204 / -35.7% 🟢 549455975 / 919536196 / -40.2% 🟢 0.77 / 0.72 / +7.6%
tpch_q05/datafusion:vortex-file-compressed 760417780 / 699133028 / +8.8% 882710720 / 946373096 / -6.7% 0.86 / 0.74 / +16.6%
tpch_q06/datafusion:vortex-file-compressed 290554416 / 260714228 / +11.4% 618688310 / 438144903 / +41.2% 🔴 0.47 / 0.60 / -21.1%
tpch_q07/datafusion:vortex-file-compressed 665391215 / 915754801 / -27.3% 1018257640 / 1052490420 / -3.3% 0.65 / 0.87 / -24.9%
tpch_q08/datafusion:vortex-file-compressed 871658053 / 1214342954 / -28.2% 1157740571 / 1561682799 / -25.9% 0.75 / 0.78 / -3.2%
tpch_q09/datafusion:vortex-file-compressed 1036266630 / 767693606 / +35.0% 🔴 1098183998 / 1197309489 / -8.3% 0.94 / 0.64 / +47.2%
tpch_q10/datafusion:vortex-file-compressed 678810214 / 707591169 / -4.1% 767133790 / 847560827 / -9.5% 0.88 / 0.83 / +6.0%
tpch_q11/datafusion:vortex-file-compressed 327178457 / 402907316 / -18.8% 633664858 / 635583995 / -0.3% 0.52 / 0.63 / -18.5%
tpch_q12/datafusion:vortex-file-compressed 396548792 / 421921703 / -6.0% 453518017 / 633807353 / -28.4% 0.87 / 0.67 / +31.3%
tpch_q13/datafusion:vortex-file-compressed 372508190 / 272536437 / +36.7% 🔴 899965163 / 583911344 / +54.1% 🔴 0.41 / 0.47 / -11.3%
tpch_q14/datafusion:vortex-file-compressed 372965249 / 326780020 / +14.1% 554512966 / 589382406 / -5.9% 0.67 / 0.55 / +21.3%
tpch_q15/datafusion:vortex-file-compressed 918401685 / 665655623 / +38.0% 🔴 1152282554 / 802701797 / +43.6% 🔴 0.80 / 0.83 / -3.9%
tpch_q16/datafusion:vortex-file-compressed 236641807 / 242140758 / -2.3% 419661171 / 457367252 / -8.2% 0.56 / 0.53 / +6.5%
tpch_q17/datafusion:vortex-file-compressed 775974627 / 780584694 / -0.6% 1069143488 / 925945975 / +15.5% 0.73 / 0.84 / -13.9%
tpch_q18/datafusion:vortex-file-compressed 989576466 / 957119904 / +3.4% 1251599611 / 992766738 / +26.1% 0.79 / 0.96 / -18.0%
tpch_q19/datafusion:vortex-file-compressed 489265216 / 1172395244 / -58.3% 🟢 768393792 / 688687037 / +11.6% 0.64 / 1.70 / -62.6%
tpch_q20/datafusion:vortex-file-compressed 598770600 / 695425032 / -13.9% 838314379 / 1043180945 / -19.6% 0.71 / 0.67 / +7.1%
tpch_q21/datafusion:vortex-file-compressed 1028699108 / 1035141874 / -0.6% 1062258706 / 1022114407 / +3.9% 0.97 / 1.01 / -4.4%
tpch_q22/datafusion:vortex-file-compressed 285963311 / 258933423 / +10.4% 572580323 / 575017216 / -0.4% 0.50 / 0.45 / +10.9%
datafusion / vortex-compact / ns (0.984x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-compact 321126310 / 323450907 / -0.7% 859210293 / 1062085534 / -19.1% 0.37 / 0.30 / +22.7%
tpch_q02/datafusion:vortex-compact 484988165 / 1182145043 / -59.0% 🟢 1039982138 / 1623215327 / -35.9% 🟢 0.47 / 0.73 / -36.0%
tpch_q03/datafusion:vortex-compact 480453388 / 510182011 / -5.8% 1350421070 / 1276420899 / +5.8% 0.36 / 0.40 / -11.0%
tpch_q04/datafusion:vortex-compact 407257601 / 341217182 / +19.4% 505396144 / 602156574 / -16.1% 0.81 / 0.57 / +42.2%
tpch_q05/datafusion:vortex-compact 752861853 / 735690830 / +2.3% 1074685098 / 975630781 / +10.2% 0.70 / 0.75 / -7.1%
tpch_q06/datafusion:vortex-compact 300579706 / 295201889 / +1.8% 476402686 / 383990351 / +24.1% 0.63 / 0.77 / -17.9%
tpch_q07/datafusion:vortex-compact 933861871 / 1020465519 / -8.5% 1002243876 / 1119382327 / -10.5% 0.93 / 0.91 / +2.2%
tpch_q08/datafusion:vortex-compact 967792065 / 872855436 / +10.9% 1124534074 / 1162918711 / -3.3% 0.86 / 0.75 / +14.7%
tpch_q09/datafusion:vortex-compact 836698093 / 724587100 / +15.5% 960692330 / 1156721109 / -16.9% 0.87 / 0.63 / +39.0%
tpch_q10/datafusion:vortex-compact 583804298 / 547321428 / +6.7% 814231867 / 821203806 / -0.8% 0.72 / 0.67 / +7.6%
tpch_q11/datafusion:vortex-compact 575919727 / 395516730 / +45.6% 🔴 669207569 / 665108678 / +0.6% 0.86 / 0.59 / +44.7%
tpch_q12/datafusion:vortex-compact 390935044 / 385594775 / +1.4% 565542372 / 508247656 / +11.3% 0.69 / 0.76 / -8.9%
tpch_q13/datafusion:vortex-compact 258268888 / 292397278 / -11.7% 544792740 / 615864318 / -11.5% 0.47 / 0.47 / -0.1%
tpch_q14/datafusion:vortex-compact 374878666 / 279310240 / +34.2% 🔴 523272722 / 623059078 / -16.0% 0.72 / 0.45 / +59.8%
tpch_q15/datafusion:vortex-compact 587202713 / 589895359 / -0.5% 753792174 / 778501413 / -3.2% 0.78 / 0.76 / +2.8%
tpch_q16/datafusion:vortex-compact 265687706 / 344448860 / -22.9% 548348523 / 482525345 / +13.6% 0.48 / 0.71 / -32.1%
tpch_q17/datafusion:vortex-compact 746026240 / 799898782 / -6.7% 763712806 / 1039284117 / -26.5% 0.98 / 0.77 / +26.9%
tpch_q18/datafusion:vortex-compact 796008497 / 583771356 / +36.4% 🔴 1100926908 / 659174816 / +67.0% 🔴 0.72 / 0.89 / -18.4%
tpch_q19/datafusion:vortex-compact 404564152 / 495837621 / -18.4% 685791679 / 518658863 / +32.2% 🔴 0.59 / 0.96 / -38.3%
tpch_q20/datafusion:vortex-compact 532220318 / 512849777 / +3.8% 716701511 / 706832386 / +1.4% 0.74 / 0.73 / +2.3%
tpch_q21/datafusion:vortex-compact 1032380654 / 1187688502 / -13.1% 1287643267 / 1343463485 / -4.2% 0.80 / 0.88 / -9.3%
tpch_q22/datafusion:vortex-compact 289355991 / 312116149 / -7.3% 749863581 / 595010909 / +26.0% 0.39 / 0.52 / -26.4%
datafusion / parquet / ns (0.966x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 280167524 / 311043678 / -9.9% 728568831 / 727069428 / +0.2% 0.38 / 0.43 / -10.1%
tpch_q02/datafusion:parquet 467467236 / 478746423 / -2.4% 927660476 / 1042665553 / -11.0% 0.50 / 0.46 / +9.7%
tpch_q03/datafusion:parquet 505743835 / 465381816 / +8.7% 1078012359 / 1023832570 / +5.3% 0.47 / 0.45 / +3.2%
tpch_q04/datafusion:parquet 347620909 / 420806509 / -17.4% 589585104 / 574486979 / +2.6% 0.59 / 0.73 / -19.5%
tpch_q05/datafusion:parquet 604034399 / 598231783 / +1.0% 966894370 / 937463359 / +3.1% 0.62 / 0.64 / -2.1%
tpch_q06/datafusion:parquet 231591011 / 230596367 / +0.4% 380393587 / 462864639 / -17.8% 0.61 / 0.50 / +22.2%
tpch_q07/datafusion:parquet 576988474 / 638753595 / -9.7% 725322045 / 923492939 / -21.5% 0.80 / 0.69 / +15.0%
tpch_q08/datafusion:parquet 670374377 / 732470246 / -8.5% 914051565 / 1113688682 / -17.9% 0.73 / 0.66 / +11.5%
tpch_q09/datafusion:parquet 878761111 / 1244383885 / -29.4% 1035341972 / 1327487529 / -22.0% 0.85 / 0.94 / -9.5%
tpch_q10/datafusion:parquet 1120694357 / 1328956268 / -15.7% 1531880075 / 1591656571 / -3.8% 0.73 / 0.83 / -12.4%
tpch_q11/datafusion:parquet 376506203 / 412576382 / -8.7% 615496146 / 653411709 / -5.8% 0.61 / 0.63 / -3.1%
tpch_q12/datafusion:parquet 539180314 / 380838250 / +41.6% 🔴 869483468 / 637880520 / +36.3% 🔴 0.62 / 0.60 / +3.9%
tpch_q13/datafusion:parquet 427768269 / 465535442 / -8.1% 699325784 / 702897524 / -0.5% 0.61 / 0.66 / -7.6%
tpch_q14/datafusion:parquet 481401237 / 346519442 / +38.9% 🔴 1060070043 / 728976287 / +45.4% 🔴 0.45 / 0.48 / -4.5%
tpch_q15/datafusion:parquet 572083364 / 604011842 / -5.3% 748367314 / 902791958 / -17.1% 0.76 / 0.67 / +14.3%
tpch_q16/datafusion:parquet 211334883 / 333823035 / -36.7% 🟢 410841270 / 836733607 / -50.9% 🟢 0.51 / 0.40 / +28.9%
tpch_q17/datafusion:parquet 656939348 / 524280915 / +25.3% 943184792 / 799090834 / +18.0% 0.70 / 0.66 / +6.2%
tpch_q18/datafusion:parquet 518893357 / 557690863 / -7.0% 750124870 / 741317063 / +1.2% 0.69 / 0.75 / -8.0%
tpch_q19/datafusion:parquet 461490369 / 436820043 / +5.6% 597008353 / 832064589 / -28.2% 0.77 / 0.52 / +47.2%
tpch_q20/datafusion:parquet 715189060 / 725862456 / -1.5% 752493377 / 919635187 / -18.2% 0.95 / 0.79 / +20.4%
tpch_q21/datafusion:parquet 939757990 / 959361698 / -2.0% 1088901684 / 1153494961 / -5.6% 0.86 / 0.83 / +3.8%
tpch_q22/datafusion:parquet 423825263 / 422181456 / +0.4% 883751835 / 729371372 / +21.2% 0.48 / 0.58 / -17.1%
duckdb / vortex-file-compressed / ns (0.918x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 936263315 / 965462650 / -3.0% 1258845345 / 1402780977 / -10.3% 0.74 / 0.69 / +8.1%
tpch_q02/duckdb:vortex-file-compressed 606570669 / 573969981 / +5.7% 739477214 / 738994152 / +0.1% 0.82 / 0.78 / +5.6%
tpch_q03/duckdb:vortex-file-compressed 1328896979 / 1312400402 / +1.3% 1690243732 / 1904622997 / -11.3% 0.79 / 0.69 / +14.1%
tpch_q04/duckdb:vortex-file-compressed 1007749310 / 1030784345 / -2.2% 1238107167 / 1288656265 / -3.9% 0.81 / 0.80 / +1.8%
tpch_q05/duckdb:vortex-file-compressed 1028891468 / 1217249690 / -15.5% 1278221107 / 1659512715 / -23.0% 0.80 / 0.73 / +9.7%
tpch_q06/duckdb:vortex-file-compressed 752124730 / 872267315 / -13.8% 871602735 / 1027293421 / -15.2% 0.86 / 0.85 / +1.6%
tpch_q07/duckdb:vortex-file-compressed 1248098301 / 1264040497 / -1.3% 1417259952 / 1357921038 / +4.4% 0.88 / 0.93 / -5.4%
tpch_q08/duckdb:vortex-file-compressed 1381746000 / 1298484121 / +6.4% 1640873953 / 1571549403 / +4.4% 0.84 / 0.83 / +1.9%
tpch_q09/duckdb:vortex-file-compressed 1353005015 / 1527134196 / -11.4% 1620489899 / 1672041719 / -3.1% 0.83 / 0.91 / -8.6%
tpch_q10/duckdb:vortex-file-compressed 1659893397 / 1549614045 / +7.1% 1938553505 / 1715237592 / +13.0% 0.86 / 0.90 / -5.2%
tpch_q11/duckdb:vortex-file-compressed 499043215 / 402453267 / +24.0% 509349721 / 510197928 / -0.2% 0.98 / 0.79 / +24.2%
tpch_q12/duckdb:vortex-file-compressed 903452444 / 1263159322 / -28.5% 1087838939 / 1453063352 / -25.1% 0.83 / 0.87 / -4.5%
tpch_q13/duckdb:vortex-file-compressed 389160172 / 606411234 / -35.8% 🟢 570660041 / 644338934 / -11.4% 0.68 / 0.94 / -27.5%
tpch_q14/duckdb:vortex-file-compressed 889224091 / 983047916 / -9.5% 1005232509 / 1074299181 / -6.4% 0.88 / 0.92 / -3.3%
tpch_q15/duckdb:vortex-file-compressed 836480121 / 854148760 / -2.1% 895375185 / 973608894 / -8.0% 0.93 / 0.88 / +6.5%
tpch_q16/duckdb:vortex-file-compressed 276327326 / 368819515 / -25.1% 309571863 / 414246849 / -25.3% 0.89 / 0.89 / +0.3%
tpch_q17/duckdb:vortex-file-compressed 1150648980 / 1198275030 / -4.0% 1346628593 / 1313126919 / +2.6% 0.85 / 0.91 / -6.4%
tpch_q18/duckdb:vortex-file-compressed 1051479729 / 1116395708 / -5.8% 1180364734 / 1280453553 / -7.8% 0.89 / 0.87 / +2.2%
tpch_q19/duckdb:vortex-file-compressed 1015058105 / 1197028182 / -15.2% 1351147561 / 1211307807 / +11.5% 0.75 / 0.99 / -24.0%
tpch_q20/duckdb:vortex-file-compressed 1016441781 / 1126854965 / -9.8% 1438871181 / 1433941383 / +0.3% 0.71 / 0.79 / -10.1%
tpch_q21/duckdb:vortex-file-compressed 2401898462 / 2360233407 / +1.8% 2497820928 / 2500199911 / -0.1% 0.96 / 0.94 / +1.9%
tpch_q22/duckdb:vortex-file-compressed 358375327 / 462775525 / -22.6% 664559218 / 703782857 / -5.6% 0.54 / 0.66 / -18.0%
duckdb / vortex-compact / ns (0.935x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-compact 880460331 / 964495423 / -8.7% 1327552151 / 1889191420 / -29.7% 0.66 / 0.51 / +29.9%
tpch_q02/duckdb:vortex-compact 502081820 / 536162248 / -6.4% 658653964 / 807565179 / -18.4% 0.76 / 0.66 / +14.8%
tpch_q03/duckdb:vortex-compact 1146108346 / 1231229706 / -6.9% 1858794416 / 1851408691 / +0.4% 0.62 / 0.67 / -7.3%
tpch_q04/duckdb:vortex-compact 851694258 / 947763124 / -10.1% 1105746419 / 1186590677 / -6.8% 0.77 / 0.80 / -3.6%
tpch_q05/duckdb:vortex-compact 986721504 / 1061464205 / -7.0% 1337991406 / 1388742272 / -3.7% 0.74 / 0.76 / -3.5%
tpch_q06/duckdb:vortex-compact 710151738 / 792652798 / -10.4% 822638860 / 902655140 / -8.9% 0.86 / 0.88 / -1.7%
tpch_q07/duckdb:vortex-compact 1353525140 / 1246099237 / +8.6% 1589199261 / 1397540268 / +13.7% 0.85 / 0.89 / -4.5%
tpch_q08/duckdb:vortex-compact 1125521475 / 1218835789 / -7.7% 1358114004 / 1567332881 / -13.3% 0.83 / 0.78 / +6.6%
tpch_q09/duckdb:vortex-compact 1254076048 / 1301848281 / -3.7% 1521024239 / 1844961575 / -17.6% 0.82 / 0.71 / +16.8%
tpch_q10/duckdb:vortex-compact 1277630375 / 1419798881 / -10.0% 1524969169 / 1827686551 / -16.6% 0.84 / 0.78 / +7.8%
tpch_q11/duckdb:vortex-compact 429751867 / 386328317 / +11.2% 698651835 / 540142999 / +29.3% 0.62 / 0.72 / -14.0%
tpch_q12/duckdb:vortex-compact 863522360 / 854357559 / +1.1% 1038300298 / 1032146976 / +0.6% 0.83 / 0.83 / +0.5%
tpch_q13/duckdb:vortex-compact 405461164 / 635390195 / -36.2% 🟢 512672523 / 868463466 / -41.0% 🟢 0.79 / 0.73 / +8.1%
tpch_q14/duckdb:vortex-compact 977119426 / 958001301 / +2.0% 1338714631 / 1036761934 / +29.1% 0.73 / 0.92 / -21.0%
tpch_q15/duckdb:vortex-compact 821746369 / 851522604 / -3.5% 1085889317 / 1083395094 / +0.2% 0.76 / 0.79 / -3.7%
tpch_q16/duckdb:vortex-compact 275160089 / 283274928 / -2.9% 386850836 / 336802120 / +14.9% 0.71 / 0.84 / -15.4%
tpch_q17/duckdb:vortex-compact 980153904 / 935361221 / +4.8% 1103591478 / 1234663504 / -10.6% 0.89 / 0.76 / +17.2%
tpch_q18/duckdb:vortex-compact 981998061 / 1174851940 / -16.4% 1084310570 / 1267194664 / -14.4% 0.91 / 0.93 / -2.3%
tpch_q19/duckdb:vortex-compact 1111243687 / 1123239612 / -1.1% 1205501008 / 1305509200 / -7.7% 0.92 / 0.86 / +7.1%
tpch_q20/duckdb:vortex-compact 1137808013 / 1127963345 / +0.9% 1254149329 / 1216444309 / +3.1% 0.91 / 0.93 / -2.2%
tpch_q21/duckdb:vortex-compact 2301881898 / 2762377151 / -16.7% 2472802648 / 2585046938 / -4.3% 0.93 / 1.07 / -12.9%
tpch_q22/duckdb:vortex-compact 362379068 / 409720123 / -11.6% 543220778 / 909586900 / -40.3% 🟢 0.67 / 0.45 / +48.1%
duckdb / parquet / ns (0.979x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 399627043 / 440003089 / -9.2% 410374854 / 889078896 / -53.8% 🟢 0.97 / 0.49 / +96.8%
tpch_q02/duckdb:parquet 583294057 / 587827260 / -0.8% 722218577 / 775012706 / -6.8% 0.81 / 0.76 / +6.5%
tpch_q03/duckdb:parquet 567954394 / 746807091 / -23.9% 1883927473 / 1333946209 / +41.2% 🔴 0.30 / 0.56 / -46.2%
tpch_q04/duckdb:parquet 497396231 / 444326337 / +11.9% 521888065 / 1480613627 / -64.8% 🟢 0.95 / 0.30 / +217.6%
tpch_q05/duckdb:parquet 746796028 / 743469257 / +0.4% 889914145 / 1031102551 / -13.7% 0.84 / 0.72 / +16.4%
tpch_q06/duckdb:parquet 243260144 / 309918299 / -21.5% 320165276 / 278326526 / +15.0% 0.76 / 1.11 / -31.8%
tpch_q07/duckdb:parquet 816759021 / 931144281 / -12.3% 931977539 / 882246165 / +5.6% 0.88 / 1.06 / -17.0%
tpch_q08/duckdb:parquet 997471507 / 1033933265 / -3.5% 1082219465 / 1097275485 / -1.4% 0.92 / 0.94 / -2.2%
tpch_q09/duckdb:parquet 1042367176 / 1067544848 / -2.4% 1185566798 / 1182580215 / +0.3% 0.88 / 0.90 / -2.6%
tpch_q10/duckdb:parquet 843604881 / 874126528 / -3.5% 1119212229 / 1248738099 / -10.4% 0.75 / 0.70 / +7.7%
tpch_q11/duckdb:parquet 514310094 / 361632924 / +42.2% 🔴 418698429 / 362336442 / +15.6% 1.23 / 1.00 / +23.1%
tpch_q12/duckdb:parquet 409960216 / 540141018 / -24.1% 522881989 / 599156237 / -12.7% 0.78 / 0.90 / -13.0%
tpch_q13/duckdb:parquet 541500159 / 568381947 / -4.7% 696401848 / 732504584 / -4.9% 0.78 / 0.78 / +0.2%
tpch_q14/duckdb:parquet 505218868 / 592038940 / -14.7% 683287034 / 487842400 / +40.1% 🔴 0.74 / 1.21 / -39.1%
tpch_q15/duckdb:parquet 550758102 / 487459185 / +13.0% 728641454 / 603433586 / +20.7% 0.76 / 0.81 / -6.4%
tpch_q16/duckdb:parquet 384614807 / 377071292 / +2.0% 409942125 / 380105707 / +7.8% 0.94 / 0.99 / -5.4%
tpch_q17/duckdb:parquet 585760857 / 619283330 / -5.4% 524120072 / 714183429 / -26.6% 1.12 / 0.87 / +28.9%
tpch_q18/duckdb:parquet 541284112 / 492212862 / +10.0% 1036093280 / 582470770 / +77.9% 🔴 0.52 / 0.85 / -38.2%
tpch_q19/duckdb:parquet 624996450 / 652262065 / -4.2% 485257459 / 679715176 / -28.6% 1.29 / 0.96 / +34.2%
tpch_q20/duckdb:parquet 858279524 / 947076667 / -9.4% 720908164 / 821857174 / -12.3% 1.19 / 1.15 / +3.3%
tpch_q21/duckdb:parquet 968624525 / 735271824 / +31.7% 🔴 1006953414 / 894602195 / +12.6% 0.96 / 0.82 / +17.0%
tpch_q22/duckdb:parquet 534797296 / 499747470 / +7.0% 559068482 / 574519467 / -2.7% 0.96 / 0.87 / +10.0%

@robert3005
robert3005 force-pushed the rk/optimize-with-session branch 2 times, most recently from 45e33b5 to bbfce4d Compare October 28, 2026 17:44
@robert3005 robert3005 added the action/bench-sql-extended Run all regular SQL benchmarks with full PR target coverage label Oct 29, 2026
robert3005
robert3005 commented Oct 29, 2026
View reviewed changes
Comment thread vortex-array/src/arrays/chunked/vtable/mod.rs Resolved
robert3005
robert3005 commented Oct 29, 2026
View reviewed changes
Comment thread vortex-array/src/builders/child.rs Resolved
robert3005
robert3005 commented Oct 29, 2026
View reviewed changes
Comment thread vortex-array/src/optimizer/kernels.rs Resolved
@robert3005
robert3005 force-pushed the rk/optimize-with-session branch 2 times, most recently from 530cc95 to c6471a5 Compare October 29, 2026 13:57
@robert3005
robert3005 marked this pull request as ready for review October 29, 2026 15:23
@robert3005
robert3005 force-pushed the rk/optimize-with-session branch from c6471a5 to ad3fc66 Compare October 29, 2026 15:43
claude and others added 16 commits October 30, 2026 16:30
@claude @robert3005
Optimize scanned arrays before the scan returns them
5d2a809 
Layout readers apply the projection lazily, and apply no longer optimizes,
so a scan of a struct returned a pack expression rather than a struct.
vx_array_get_field, and the C++ Array::field built on it, require a struct
and rejected it. The scan now optimizes each split's array with its
session, as does the physical plan's eval stage.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Claude <noreply@anthropic.com>
@claude @robert3005
Optimize with either a session or an execution context
bd6583d 
ArrayOptimizer::optimize and optimize_recursive take any AsOptimizerKernels
source: a VortexSession snapshots its kernels for the call, while an
ExecutionCtx reuses the snapshot it took when it was created. Kernels that
optimize what they build now call array.optimize(ctx) instead of passing
the context's kernel snapshot to optimize_with_kernels.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Claude <noreply@anthropic.com>
@robert3005 @claude
Update the contiguous filter trace for slices pushed through filters
8f20a5c 
Develop now pushes a slice through a filter, and that rule is registered in
the session like the others, so optimizing the nested filter reaches the
primitive without executing.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 @claude
Optimize the sliced filter in slice_filter_limits_child
fc55d5a 
Slicing builds a lazy slice, so the test optimizes with a session before
it checks how much of the child the pushed-down slice kept.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 @claude
Optimize a node's unoptimized children before its own rules
ebb4349 
Constructors build lazy arrays, so a parent could reach the optimizer and
executor with a child that is still a lazy wrapper, such as a slice of an
FSST array under a LIKE. Parent rules and execute-parent kernels keyed on
the child's encoding then missed it: the FSST LIKE kernel never fired and
the strings were decompressed instead, slowing ClickBench q23 on DuckDB.

Optimizing a node now first optimizes the descendants below it that were
never optimized, bottom up, as eager constructors used to. Children already
optimized are left without visiting their subtrees.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 @claude
Mark arrays decoded from disk as tree optimized
7c7b1e1 
The writer stores arrays after optimizing them, so a decoded array and the
tree below it need no further rewrites. Marking them lets the optimizer and
executor skip them without trying any rule.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 @claude
Accept lazy chunks in the dict encoder and flat writer
3e57138 
Slices are now lazy, so written chunks can be a slice of an array rather
than the array's own encoding. The dict encoder picks its builder from the
dtype, since both builders already execute non-canonical input, and the
flat writer optimizes a chunk before serializing it, since lazy nodes have
no serialized form.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 @claude
Drop the flat writer's optimize; chunks are optimized before writing
764d817 
The write path optimizes chunks before they reach a layout writer, so the
flat writer does not need to optimize them again. The dict writer test that
feeds raw slices to the strategy now optimizes them as that path does.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_018SWbErbGQPZvkCK9ZXH87w
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Simplify the optimized mark and keep stats after optimize
abb1826 
- Use one optimized bit. The optimizer marks a node only after its
  children, so the mark covers the whole tree. Remove the recursive
  pass and its trace events.
- Copy the stats of the input array to the rewritten array.
- Derive the child id in register_reduce_parent_rule from the vtable,
  and add register_scalar_fn_reduce_parent_rule.
- Make is_optimized, is_recursively_optimized, has_reduce_parent and
  DynReduceParentKernel private to the crate.
- Fix the mark_decoded_optimized and zstd docs.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
format
54619d8 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Remove stale optimize_recursive trace lines and a redundant doc link
a40cba9 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Optimize lazy arrays before CUDA dispatch
217a9c5 
Constructors are lazy, so a slice or cast reaches the CUDA kernels as a
Slice or ScalarFn array instead of the encoding they match.

- Optimize on entry to execute_cuda and before the ListView rebuild
  exports its child.
- Register the default file encodings in cuda_session so the
  optimizer has their parent-reduce rules.
- Optimize the lazy fixtures in tests that call one executor directly.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Fix the last two CUDA test fixtures for lazy arrays
8e3c9fc 
- Register the default file encodings in the varbin export test
  session, so a slice of an FSST array reduces to FSST.
- Test the device dictionary guard with fixed-size list values. The
  optimizer now pushes a dictionary of structs into the struct fields,
  which CUDA decodes, so that fixture no longer reached the guard.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Keep the optimized check private to the optimizer and fix the decode doc
1569abb 
Only the optimizer reads `OptimizedState::is_optimized`, so make it private.
The doc of `mark_decoded_optimized` said that decoded children stay unmarked,
but decoding marks every node it decodes. Only the nodes that a deserializer
builds itself stay unmarked.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
Optimize arrays that plan v2 keeps for later use
b81dee5 
Constructors are lazy now, so arrays that the scan pipeline keeps and uses
again were optimized again for each use:

- `take_rows` put the rest of a batch back into its inlet as one more lazy
  slice. Each pack step made the chain deeper, and each later step optimized
  the full chain again. This made ClickBench q23 on DataFusion about 300x
  slower.
- `TakeSource` and the share plan keep their values in a `Shared` and in the
  value cache, and each batch optimized the source again.
- `ScanSource` sent lazy slices and filters of decoded segments to every
  later stage.

Optimize these arrays once, before they are kept.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
format
e9809aa 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
robert3005 force-pushed the rk/optimize-with-session branch from 221a559 to e9809aa Compare October 30, 2026 16:30
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@robert3005
Optimize shared nodes once per call and optimize scan batches eagerly
9d60f2e 
The optimizer now remembers, for one optimize call, the array it rewrote
each shared node into. Many parents can hold the same unoptimized node,
such as the struct below every field of a projection. Before, each parent
rewrote the node and its whole subtree again.

Plan v2 now optimizes the rows that take_rows returns and the struct that
PackSource builds, so the stages that read them get optimized arrays.

The execution context keeps both kernel snapshots in one shared field, and
the session publishes a parent-reduce snapshot that the optimizer reads
without a reference-count write.

Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005
format
ba9dbb7 
Signed-off-by: Robert Kruszewski <github@robertk.io>
@robert3005 robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 31, 2026
@robert3005
robert3005 enabled auto-merge (squash) October 31, 2026 01:22
@vortex-data vortex-data deleted a comment from github-actions Bot Nov 2, 2026
This was referenced Nov 2, 2026
Merged
Open
Draft
Draft
@connortsui20 connortsui20 mentioned this pull request Nov 2, 2026
Open
6 of 44 tasks

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/break A breaking API change

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@robert3005 @claude